Politics Business Culture Technology Environment Travel World
Home Technology Feature
Technology · Exclusive

Deepfake Pornography Surge Driven by Generative AI, Report Finds

Deepfake Pornography Surge Driven by Generative AI, Report Finds
Technology · 2023
Photo · Kai Lindgren for European Pulse
By Kai Lindgren Technology Editor Oct 20, 2023 3 min read

A comprehensive analysis has documented a dramatic rise in deepfake content across the internet, with the overwhelming majority—98 percent—consisting of non-consensual pornography. The report, published by the digital safety platform HomeSecurityHeroes, examined 95,820 deepfake videos, 85 dedicated online channels, and over 100 websites, revealing a 550 percent increase in such videos compared to 2019.

Generative artificial intelligence, particularly through generative adversarial networks (GANs), has made it possible to create hyper-realistic fake videos, images, and audio. The report notes that a one-minute deepfake pornographic video can now be produced in less than 25 minutes using a single clear facial image of the victim, at no cost. This accessibility has fueled an epidemic that victims describe as devastating. One survivor called it “a lifelong sentence.”

South Korea at the Epicentre

The nationality most represented among deepfake pornography victims is South Korean, a trend the report attributes to the global reach of K-pop. Three of the four members of Blackpink, South Korea’s leading girl group, appear among the top ten most targeted individuals. Chris Nguyen, head of research analysis for the report, explained: “K-pop idols are known for their widespread visibility and fan following, both within South Korea and internationally. Their public profiles and extensive fan base mean that the creation and distribution of deepfake pornography involving them are more likely to reach a larger audience.”

Nguyen also pointed to an “exceptionally high” demand for content featuring K-pop idols, which some exploit by creating explicit deepfakes on adult websites to attract traffic. He noted that South Korea’s strict regulations on pornography may inadvertently drive the phenomenon, citing the “Streisand effect”: attempts to suppress information can backfire, amplifying interest. After South Korea, the most targeted nationalities are the United States, Japan, and the United Kingdom.

Widespread Distribution and Ethical Concerns

The analysis found that seven of the ten most visited pornographic websites host deepfake content. Across the top ten dedicated deepfake pornography sites, more than 303 million video views have been recorded, underscoring the scale of consumption. The report calls for a broader conversation about the ethical implications of creating and distributing such material, emphasizing that 99 percent of victims are women.

The surge in deepfakes is driven by two factors: the technical maturity of GANs, which enable realistic manipulation, and the proliferation of user-friendly tools built on these frameworks. “These platforms offer a range of features, from simple face swapping to more complex video manipulations,” the report states. Online communities dedicated to deepfake creation have fostered collaboration and knowledge sharing, accelerating the spread of open-source projects.

In response to growing concerns, the European Union has taken steps to address the issue. The EU recently delayed enforcement of its AI Act while banning nudifier apps following a deepfake incident involving Italian Prime Minister Giorgia Meloni. This landmark crackdown reflects the urgency of regulating generative AI tools that enable abuse. Separately, the EU has banned AI nudification apps as part of a broader effort to protect individuals from digital exploitation.

The report’s authors stress that technological solutions alone are insufficient. They advocate for stronger legal frameworks, public awareness campaigns, and platform accountability to curb the creation and distribution of deepfake pornography. As generative AI continues to evolve, the line between reality and fabrication blurs, posing profound challenges for privacy, consent, and security across Europe and beyond.

More from this story

Next article · Don't miss

Sofia Hosts International Cat Show Expo with 150 Felines from Across Europe

Over 150 cats from across Europe competed in Sofia, Bulgaria, at the International Cat Show Expo. Judges from multiple countries evaluated the felines in a prestigious contest. The event drew cat enthusiasts from the continent.

Read the story →
Sofia Hosts International Cat Show Expo with 150 Felines from Across Europe