Xiaohongshu Bans Accounts for AI-Generated Toxic Animations and Minor Exploitation

Chinese social media platform Xiaohongshu has permanently banned numerous accounts and removed tens of thousands of posts for violating minor protection policies, including using AI to generate disturbing "toxic animations" and inducing minors into soft-porn chatting. Additionally, the platform cracked down on travel-related scams and unlicensed tourism marketing accounts during the summer travel season. This cleanup highlights the growing challenge platforms face as generative AI makes it easier to mass-produce disturbing content targeting children, a modern iteration of the "Elsagate" phenomenon. It also reflects China's tightening regulatory oversight on minor protection and online safety during school holidays. Xiaohongshu has upgraded its risk identification models to proactively intercept coded slang, modified images, and other methods used to bypass moderation. The platform also restricted search traffic for high-risk travel activities like cliff swings and cooperated with police to bust four criminal groups registering fake professional accounts.