Discord's AI Moderation Bug Wrongly Banned Users Over Safe Images

Discord has admitted that its AI moderation system incorrectly flagged and banned accounts for harmless images, causing disruptions for many users. The bug triggered false positives that treated innocuous content as violating policies, leading to wrongful bans. This incident highlights ongoing challenges with automated content moderation and the risk of overreliance on AI.

Sources (1)