The Korea Communications Standards Commission on Wednesday asked messaging app Telegram to delete and block sexually explicit deep fake images — created using artificial intelligence (AI) — from their platforms.
This comes after South Korean Pres. Yoon Suk Yeol called for a probe into rising deepfake abuse, and morphed photos of women — including students, teachers, and military personnel — were reportedly found in one Telegram chatroom with around 220K members.
South Korea's deepfake pornography crisis has exposed the dark underbelly of the nation's digital landscape, where social media and messaging platforms' strong encryption and non-cooperation with law enforcement have inadvertently created a haven for cybercriminals engaging in digital sex crimes.
AI-powered deepfake technology is another tool for creative expression, and like other mediums, the ethical line can easily be drawn at consent and intent. The focus must now be on establishing norms, laws, and standards governing their use, balancing innovation with individual rights and public trust.