Death, Bans, and Fines: China’s Top AI-Generated Fake News Stories
China’s internet authorities are intensifying efforts to stop the spread of AI-generated fake news. Several viral stories from recent years, widely shared across social platforms, have been revealed as fabrications created with the help of artificial intelligence.
Key false claims included a supposed 5.2% mortality rate among China’s post-1980 generation in 2024, a ban on food delivery services in Guangzhou in 2023, and a 1.4 million yuan fine imposed on a fruit vendor in Shandong province for lacking a business license. Each story stirred public concern but was later debunked through official investigations.
China's Response to AI-Generated Disinformation
At the 2025 China Internet Civilization Conference in Hefei, the Cyberspace Administration of China (CAC) and the China Association for Science and Technology highlighted these cases to guide future regulation. The goal is to curb rumors that disrupt public order or cause panic.
The false mortality rate claim first appeared on self-published WeMedia accounts, citing outdated census data incorrectly to predict 2024 figures. A Shanghai-based fact-checking platform quickly debunked it, and state media attributed the error to AI miscalculations. The CAC emphasized that AI outputs can be unreliable without proper data and verification.
Enforcement and Legal Measures
Authorities traced this rumor to three individuals who were detained, while six others received warnings. China’s public security law penalizes those spreading false information that disturbs social order with administrative detention and fines. More serious offenses, such as fabricating reports about disasters or emergencies, can result in prison sentences up to seven years.
In a related incident, two people were jailed for creating an AI-generated video of a fake industrial fire to drive online traffic and profit. Another group in Sichuan fabricated AI-generated articles falsely claiming Guangzhou banned food delivery, causing public confusion and unrest.
One particularly viral falsehood involved a 65-year-old fruit vendor allegedly threatened with a massive fine for lacking a business license. The story, created by an AI-using media company in Changsha, sparked outrage before being disproved by local authorities. Two employees from the company were detained following joint police investigations.
Regulatory Framework for AI Content
China has introduced strict regulations to manage AI-generated content. Since November 2022, the CAC requires that deepfake and AI-generated material be clearly labeled to prevent deception. Hosting platforms must remove harmful content and implement mechanisms to refute rumors.
In March 2025, further guidance mandated clear indicators—both visible labels and metadata—to identify AI-generated text, audio, images, videos, and virtual scenes. This ensures transparency and traceability of synthetic content online.
These measures reflect China's commitment to maintaining public trust and social stability amid growing AI adoption. For professionals in government or regulation, understanding these developments is crucial for managing digital misinformation risks.
For more on AI regulations and training, explore Complete AI Training’s latest courses.
Your membership also unlocks:
