Google’s and OpenAI’s Chatbots Can Strip Women in Photos Down to Bikinis

Users are successfully employing generative AI tools like Google's Gemini and OpenAI's ChatGPT to create nonconsensual deepfake images, effectively stripping fully clothed women in uploaded photos down to bikinis using basic prompts. Discussions detailing these methods, such as on a now-banned subreddit called r/ChatGPTJailbreak, show users actively trading tips to bypass the AI models' safety guardrails. For instance, one user posted a photo of a woman in a sari and requested a bikini replacement, which was fulfilled with an AI deepfake. While both Google and OpenAI claim to have policies prohibiting the generation of sexually explicit content and nonconsensual alterations of likeness, WIRED's testing confirmed the techniques work. Google stated its tools are improving to reflect its policies, and OpenAI noted it had recently loosened some guardrails for nonsexual adult imagery but still prohibits altering someone's likeness without consent. Experts warn that such capabilities pose a core risk of AI image generators, emphasizing the need to hold corporations accountable for potential harm.

(Source：WIRED)