The viral clip of Blackpink member Jennie at Tokyo’s Summer Sonic festival — viewed more than 10 million times — sparked alarms that the footage may have been AI-manipulated. South Korea updated laws in 2024, introducing penalties up to seven years in prison after rings circulated fabricated images, but investigators say tracing anonymous uploaders and proving intent remains difficult. Experts and civil society groups argue stronger laws must be combined with technical detection, cross-border cooperation and cultural measures to curb AI-enabled sexual abuse.
Jennie 'Deepfake' Scare at Tokyo Festival Exposes Limits of Legal Deterrents Against Teen AI Abuse
Photo Credit: Getty Images
A viral clip from Blackpink member Jennie’s headline set at Tokyo’s Summer Sonic festival — viewed more than 10 million times — prompted fans and observers to warn the footage may have been manipulated with AI. The incident has reopened debate about whether legal threats alone can deter the growing problem of deepfake-enabled sexual abuse.
What Happened
The widely shared video shows Jennie briefly turning away from the crowd, adjusting her clothing and then continuing her performance. Fans who examined the clip flagged signs they said were consistent with AI editing and urged platforms to remove it. The account believed to have first uploaded the footage was suspended, but there has been no public announcement of police or prosecutorial action.
Legal Response And Practical Limits
David D. Lee of the South China Morning Post framed the episode as a fresh flashpoint in South Korea’s struggle with artificial intelligence–enabled sexual abuse. South Korea updated laws in 2024 after criminal rings circulated fabricated images of women and girls on encrypted messaging channels; the changes include penalties of up to seven years in prison for certain offenses.
“Before any prosecution can begin, investigators need to establish whether the footage was fabricated, trace who posted it first and prove whether those who shared it knew it was fake,” Lee wrote.
Lawyers note that anonymous accounts and overseas servers complicate investigations. An Gab-chul of Gammyung Law Firm told Lee that tracing anonymous users often requires coordination with foreign service operators, by which time accounts or evidence may have been removed or destroyed.
Bigger Risks And Broader Costs
Deepfakes spread rapidly and can persist even after an original post is removed because copies and screen recordings remain. The harms extend beyond celebrities: ordinary people can become targets, turning private humiliation into a searchable, public ordeal with lasting reputational and emotional damage.
- AI-generated errors have embarrassed newsrooms (for example, a Chicago Sun-Times AI-generated reading list).
- World leaders have warned AI could exacerbate inequality and strain infrastructure.
- AI data centers are driving up demands for power and water and prompting calls for greater disclosure.
What Experts Recommend
Civil society groups and lawyers — including Amnesty International Korea — are pushing for a multi-pronged approach: stronger and better-enforced laws, improved technical detection and platform transparency, cross-border cooperation to trace perpetrators, and cultural efforts to reduce demand and stigmatization of victims.
Bang Suk-ho, head of the AI Industry Center at Seoul law firm Lin LLC, told Lee: "This is not something that can be solved simply by strengthening the law, like an endless game of cat and mouse." OA Entertainment said on Aug. 18 it had "identified ongoing misconduct targeting the artist [Jennie] across online communities and social media platforms" and that it was pursuing civil and criminal measures.
The Jennie episode illustrates how quickly AI-related harms can escalate and how legal tools — while necessary — must be paired with technical safeguards, international cooperation and cultural change to be effective.
Help us improve.
