Should parents worry? China bans AI boyfriends or girlfriends for Children

China has banned AI virtual partners for minors. This includes boyfriends, girlfriends, and relatives. Platforms are also required to remind users they’re speaking with AI, and to take breaks after lengthy conversations.

The “Perfect” digital Partner: A lure to the masses

Your AI boyfriend will never forget your birthday. Your AI girlfriend replies instantly. They know your favourite songs, can ask you how your day was, and even flirt back. Chatbot companions, unlike human relationships, are always available, never get bored, don’t argue over missed anniversaries and never leave unread messages.

Users can create a chatbot in just a few simple steps that will feel more like a partner than a software. The AI that is available today can easily be programmed to behave as a romantic partner or best friend. It can even act like parents and siblings. They are able to remember previous conversations and develop storylines. They also offer emotional reassurance.

Regulators are concerned by this unwavering availability and realism. It creates the very real danger that younger people will develop a highly unhealthy dependence on a device designed to keep the conversation going. China says that this is the type of relationship children shouldn’t have.

Draw a line in the sand around virtual relationships

China will be the first nation to expressly draw a line in the legal system around AI companionship.

These rules are part of Interim Measures on the Management of Artificial Intelligence Anthropomorphic Interactive Services in the Country, issued jointly by five government departments including the Cyberspace Administration of China (CAC).

To curb excessive attachment and protect minors’ mental well-being, the new regulations introduce several strict requirements for providers –

Reminders to Reality Check – Platforms must make it clear that users are interacting with artificial intelligence rather than a real person. Everyone who spends more than two hours of continuous chat must be reminded about their usage.
Youth Modes – Platforms must introduce dedicated youth modes with features such as usage limits and parental controls.
Crisis intervention – If providers detect that a user is experiencing severe emotional distress or expressing intentions of self-harm, they must generate supportive guidance and, in serious cases, take intervention measures, including contacting a guardian or emergency services.
Data Privacy – Companies are prohibited from using sensitive conversation data to train AI models without separate, explicit user consent.

How does Europe respond to virtual relationships

Governments in other countries are also watching but have adopted a different and less restrictive approach. Europe has not yet imposed a ban similar to that in China. The EU does NOT prohibit AI chatbots as boyfriends, girlfriends or companions. The AI Act is focused on preventing the harmful use of AI. This includes systems that exploit vulnerabilities or manipulate users. European researchers and policymakers are increasingly concerned about the emotional attachment of young people to AI. However there is currently no EU wide ban in place.

As AI becomes more prevalent in our daily lives, it is important to consider how much we want our young people to be exposed to this relationship.

Would you be worried if your kid told you that their boyfriend, best friend or girlfriend lived in their phone?