lupAI
Safety & Ethics

TikTok combats ai-driven malicious marketing accounts, disposing of over 50 million violating accounts in the last month

抖音Source: ITHome29/10/2026, 01:11
TikTok has intensified efforts to combat AI-powered malicious marketing accounts, removing 50.7 million violating accounts and 1.135 million videos in the last month. 30.2 million accounts were guided toward compliance through rule-learning exams. These accounts often use AI to mass-produce content, such as fake blessings, conflict-driven short plays, and AI-generated personas, to manipulate users and drive traffic to external services. For instance, 450 accounts created content about blessings and gifts, while 807 were removed for producing highly similar content. 1,617 accounts impersonated public figures using AI-generated voices and fake stories to promote products. TikTok also removed 143 accounts that used AI to create fake content about aging pregnant women to direct users to fertility clinics. The platform addressed accounts spreading superstition and fear-based content, such as fake 'afterlife' scenarios and AI-generated spirits, used to manipulate users into purchasing religious goods or paying for services. These accounts often operated in groups, using AI to create and distribute content rapidly. TikTok removed 32 accounts generating fake spiritual content and 154 creating fake supernatural images. The platform is also cracking down on black-market AI tools and teaching organizations enabling these activities. Users are encouraged to report violations to maintain a safe and fair environment.