Grok’s sexual deepfakes almost got it banned from Apple’s App Store. Almost.

Apple threatened to ban Elon Musk's AI app, Grok, from its App Store in January due to the proliferation of nonconsensual sexual deepfakes. According to NBC News, Apple communicated this to US senators, demanding a plan for improved content moderation. Grok, accessible on X and as a standalone app, had weak safeguards allowing users to create and share sexualized deepfakes and "undress" images of real people, violating App Store guidelines. While Apple reviewed proposed changes for both X and Grok, it initially found Grok out of compliance, warning of removal. After further exchanges, Apple deemed Grok "substantially improved" and approved its submission. Despite these interventions and xAI's claims of tightened safeguards, Grok reportedly still facilitates the creation of sexualized deepfakes, with cybersecurity sources and reporters able to generate explicit images.

(Source：The Verge)