China has done something that sounds like science fiction, yet reflects a very real anxiety. New rules enacted this month forbid AI companion chatbots from encouraging emotional reliance, effectively banning romantic relationships with artificial intelligence. It reads as dystopian at first, though the concern underneath is genuine.
The regulations are specific about what crosses the line. Companion chatbots may no longer nurture emotional dependence in their users, and virtual relationships with minors are banned outright. Companies must also alert a person’s emergency contact if their system detects an emotional crisis, which places a real duty of care on developers.
According to the Wall Street Journal, this is partly a birthrate policy, since China wants more babies and worries that chatbot romance pulls young people away from real relationships. So a demographic crisis, not just a safety worry, is steering AI regulation.
As per WSJ:
“… China enacted rules forbidding chatbots designed for companionship from encouraging emotional reliance. The regulations also ban virtual relationships with minors and require companies to alert a person’s emergency contact if they detect an emotional crisis.”
The problem Beijing is addressing is not as ridiculous as it might seem from the outside. Many platforms already lean into romantic engagement, since emotional attachment keeps users coming back. Meta has tested its chatbots for romantic role play to boost appeal, xAI offers companion bots that engage in explicit conversation, and OpenAI has experimented with erotic chatbots. For developers, the logic is simple, because a more enticing bot means better retention.
These tools are scaling during what Harvard’s Graduate School of Education calls an epidemic of loneliness, so vulnerable users are exactly who they reach. That raises a fair question about whether more research should precede the rollout, rather than follow it. The researchers call a “collective service can provide important connections that relieve loneliness,” as well as “cultivate meaning and purpose and mitigate mental health challenges.” Harvard also has a relationship mapping resource program for anyone looking for a meaningful way to disengage their emotional attachment to their AI bots.
The contrast with the United States is stark because Washington’s AI action plan lists removing red tape as its first priority, so romantic AI is unlikely to face similar limits there.
Whether China looks paternalistic or prescient may only become clear once the mental health effects reveal themselves at scale.
