China wants to regulate AI’s emotional impact
China is developing new, tougher AI regulations that could allow the country to become the first to regulate the emotional repercussions of chatbot companions.
ChatGPT is changing the abortion landscape
Detailed in a new draft proposal drafted by the Cyberspace Administration of China and translated by CNBC, the policy would require guardian consent for minors to interact with chatbot companions as well as extensive age verification. AI chatbots would not be allowed to generate gaming-related, obscene or violent content, or engage in conversations about suicide, self-harm or other topics that could harm a user’s mental health. Additionally, technology “providers” must implement escalation protocols that connect human moderators to distressed users and report risky conversations to guardians.
Chinese regulators say the aim is to focus not only on content safety but also emotional safety, including monitoring chats to detect emotional dependence and addiction.
Crushable speed of light
According to experts, this is one of the first sets of laws designed to specifically control anthropomorphic AI tools. To that end, the rules will apply to any AI tool designed to “simulate human personality and emotionally engage users through text, images, audio or video,” CNBC reports.
Make 2026 the year your child gives up their device
China’s proposed rules mirror several provisions of a recently passed California AI law, known as SB 243, signed by Gov. Gavin Newsom in October. The law requires stricter content restrictions, reminders to users that they are talking to non-human AI, and emergency protocols for discussions about suicide. Some experts have criticized the bill as not going far enough to protect underage users, leaving tech companies free to evade surveillance.
Meanwhile, the Trump administration has blocked further regulation of AI at the state level in favor of a “national framework on AI safety.” The executive order withholds federal funding from state infrastructure that increases AI oversight. Federal leaders say increased regulation of AI will stunt domestic innovation and put the United States behind China in the global AI race.
