The crisis has also evolved from sexually explicit content to other forms of abuse. Deepfakes are now used to create false endorsements, as seen in gambling ads misusing the face of singer-actor IU. The technology can tarnish an idol's reputation and cause "reputational dilution," potentially impacting their career and brand partnerships.
Illegal distribution relies heavily on Telegram chat rooms, where thousands of users share and monetize these synthetic violations behind anonymous, light-moderation walls.
While the statistics and legal battles are striking, the human toll is the most devastating aspect of this crisis. For a K-pop trainee or idol who has dedicated their adolescence to rigorous training and a squeaky-clean public image, the sudden emergence of a fabricated explicit video is a catastrophic psychological event. Lawyer Jeong Jin-kwon notes that public figures can suffer "significant harm to their image and reputation" from deepfake pornography, and even if no physical harm is inflicted, the videos are subject to penalties for sexual rights violations.
The Mechanics and Scope of an Epidemic
These young idols, still in their formative years, are not only being subjected to the pressures of fame but also the psychological distress caused by the creation and dissemination of deepfakes.
Authorities in South Korea and other countries have also taken notice, with some governments and law enforcement agencies launching investigations and cracking down on those involved in the creation and dissemination of deepfakes.
For idols, who often have their image and reputation meticulously managed, deepfakes can have a severe psychological impact. kpop idol 19 deepfake
Deepfakes are created using a type of AI called generative adversarial networks (GANs). GANs consist of two neural networks that work together to generate a fake video. The first network, called the generator, creates a fake video by manipulating the facial expressions, movements, and voice of the target person. The second network, called the discriminator, evaluates the generated video and tells the generator whether it looks realistic or not. Through this process, the generator improves its performance, and the resulting deepfake becomes increasingly convincing.
In a landmark case, 12 individuals were prosecuted for creating and distributing deepfake content targeting SM Entertainment's artists, including aespa. The offenders received prison sentences ranging from two and a half years to four years, with the sentences being finalized on appeal and the perpetrators currently serving their terms. The collaboration between agencies like HYBE and the police has also led to arrests, including eight suspects who created deepfake content using images of idols under their label.
This public link is valid for 7 days and shares a thread, including any personal information you added. This link or copies made by others cannot be deleted. If you share with third parties, their policies apply. Can’t copy the link right now. Try again later. The crisis has also evolved from sexually explicit
For those who may not be familiar, deepfakes are a type of artificial intelligence (AI) generated content that uses machine learning algorithms to create manipulated videos, images, or audio recordings. These AI-generated media can be incredibly realistic, making it difficult to distinguish between what is real and what is fake. Deepfakes have been used for a variety of purposes, including entertainment, education, and even malicious activities such as spreading misinformation or defaming public figures.
Communities systematically archive proof of deepfake distribution to submit directly to agency legal hotlines.
: The technology behind deepfakes has become increasingly sophisticated, making it harder to distinguish between real and fake content. However, researchers and tech companies are working on developing tools to detect deepfakes. Illegal distribution relies heavily on Telegram chat rooms,