Meta ads promoted an AI tool for deepfake sexual videos
Meta’s platforms recently carried advertisements for Kromix, an AI tool that appeared to encourage users to make sexually explicit deepfake videos resembling female US politicians. The ads ran despite Meta’s rules prohibiting advertising that contains sexual material. The incident is part of a broader pattern of failures to keep services producing nonconsensual intimate imagery out of the company’s advertising systems.
One video advertisement reviewed by WIRED showed a woman closely resembling a prominent female US politician standing before a US flag and the flag of the US president. A caption asked, “What if she moved?” The woman then winked, and the video cut to pornographic footage featuring a woman with the same face. A voice-over described Kromix as having “no restrictions” and said that “all the characters are real people.”
Kromix presents itself as an “AI image styler.” Its app, which had been available on Apple’s App Store before WIRED requested comment, allowed paying users to upload photographs for scenarios including “bedroom rape” and “Disney love.” Other videos showed AI-generated pornography involving women in Spider-Man costumes. A contact listed in the app did not respond to requests for comment.
Written by Sakhanda Wire AI from reporting by Ars Technica. Facts, quotes and full context are in the original article below.