A South Korean man has been sentenced to jail for using artificial intelligence to generate exploitative images of children, the first case of its kind in the country as courts around the world encounter the use of new technologies in creating abusive sexual content.
He had created about 360 AI-generated images in April, the prosecutor’s office told CNN.
Prosecutors argued during the case that the definition of sexually exploitative material should include descriptions of sexual behaviors by “virtual humans” and not just the appearance of actual children.
For years, deepfakes – highly convincing fake videos made using AI – have been used to put women’s faces into often aggressive pornographic videos, without their consent.
The videos often appear so real it can be hard for female victims to deny it isn’t really them.
The streaming platform, Twitch, responded to the controversy by tightening its policies, calling the deepfake sexual videos “personally violating and beyond upsetting.”
Other major platforms are similarly updating their rules, with TikTok adding further restrictions on sharing AI deepfakes in March. »
