Deepfake porn crisis in South Korea: Is technology fueling misogyny?

A terrifying message sprang up on a college student's phone stating that her photos and private information had been released in a Telegram message from an unidentified sender.

Screenshot 2024 09 06 at 6.05.56 PM
South Koreans have been shocked and angry since the deepfake scandal has come to light. Photo Credit: BBC

A terrifying message sprang up on a college student’s phone stating that her photos and private information had been released in a Telegram message from an unidentified sender. In the report by BBC, what appeared next was a sequence of more unsettling pictures; sophisticated deepfake technology had been used to overlay her face over sexually explicit images. The student’s name was given as Heejin (not her real name).

Deepfakes: What Are They?

Deepfakes are pictures or movies that, frequently with the aid of artificial intelligence, blend a genuine person’s face with a manufactured body or scene. Because these phoney media productions can be so lifelike, it can be challenging to tell what is real and what isn’t. The technology, which was first meant to inspire creativity and amusement, has a darker side and is increasingly being exploited for abuse and harassment.

How Deepfake Porn Rings Operate

Journalist Ko Narin discovered a network of deepfake porn rings operating in South Korea that preyed on women and girls, especially college students. These rings operate on messaging apps such as Telegram, where users post photos of themselves and their friends, and artificial intelligence (AI) software instantly turns the photos into phoney sexual content.

The Scope of the Issue

Ko found that these organisations weren’t just focused on colleges; they also attacked middle and high schools. The groups are extremely well-organised; some even have “humiliation rooms” where certain people are shamed. The country has been stunned by these groups’ systematic behaviour, which has sparked outrage and calls for action.

The Role of Telegram and Government Response

The app at the centre of this controversy, Telegram, has come under fire for its lax content moderation policies. The website has come under fire for allegedly not doing enough to monitor the illicit activity taking place in its chat rooms. The government and police of South Korea have responded by pledging to look into the matter and take appropriate measures against those responsible. Even the possibility of regulating or outlawing the app in the nation is being discussed.

The Struggles of Victims and the Psychological Cost

The revelation of these deepfake rings has caused great anxiety and suffering for victims. Out of concern that they would become the next targets, several women have started to take down their social media images. The victims experience severe psychological effects as they struggle to accept that their likenesses have been used in ways they never consented to.

The Fight for Justice and Education

Women’s rights advocates are advocating for harsher penalties for both those who produce and disseminate deepfake material as well as for those who watch it. A growing number of young men are being educated about what sexual assault is and should know, since many of the abusers are teenagers who may not fully realise the harm they are creating.

A Call for Change

A new and horrifying kind of digital abuse that is growing quickly has come to light in South Korea thanks to the deepfake scandal. Although there are positive applications of technology, this instance emphasises the urgent need for stricter laws, more victim assistance programs, and improved education. Although the fight against deepfakes is still in its early stages, there remains promise for a safer internet in the future if everyone works together.

More from Qonversations

Featured

Screenshot 2024 09 16 at 2.09.44 PM

Discovery of Ocomtún: An ancient Maya City uncovered

Featured

Screenshot 2024 09 13 at 9.43.21 AM

Did you know? A genetic error led humans to develop larger brains

Featured

blood cell

Did you know? A blood cell travels around your entire body in just one minute

Featured

2024 08 28T114236Z 62835676 RC2UO9A61W3B RTRMADP 3 MACAU LEADER

Tourist hotspots under siege: Are these top 10 destinations buckling under the weight of overcrowding?

Front of mind