Discord admits AI moderation bug wrongfully banned users over harmless images
TechCrunch
Discord apologized after an AI moderation bug incorrectly banned over 8,000 users for sharing benign images like spreadsheets and game textures.Summary
Discord has confirmed that a glitch in its AI-driven safety system caused the wrongful suspension of over 8,000 accounts during the last two months. The bug mistakenly flagged harmless images, including spreadsheets, chessboards, and game textures, as illegal or harmful content. While the company stated that human reviewers are usually intended to oversee flagged content, this specific error triggered immediate bans. Discord is currently in the process of restoring all affected accounts and working to implement better safeguards to prevent a recurrence of these false positives.
(Source：TechCrunch)