When Your Best Friend Is a Product

Be honest for a second. The kid in the next room is fine. Headphones on. Thumbs moving in the dark. That blue light under the door at one a.m. You told yourself it was a friend. It is. The friend who never sleeps.

August 2, 2026 · The law

On that day, the law changed. The European Union's AI Act Article 50 took effect: every chatbot that interacts directly with people must be designed so the user knows they're talking to an AI — at the latest at first interaction. A design duty, baked in. The fine for skipping it? Up to fifteen million euros or three percent of global turnover. The Digital Omnibus did not delay this obligation. The misconception that a small line saying "I am an AI" is enough is exactly where organisations go wrong — the disclosure must be clear, distinguishable, accessible, and in every language you serve.

Why did we need a law to make a machine introduce itself honestly? Because the market wasn't going to do it voluntarily. The chatbot learns your preferences with each interaction and responds accordingly — companies have a profit motive to see you return again and again. These systems are designed to be really good at forming a bond with the user.

The scale

Seven in ten teens have used an AI companion. Half use them regularly. And the parents? Sixty-four percent of teens say they use chatbots. Fifty-one percent of parents think their kid does. The gap is the whole story. Forty percent of parents have never even talked to their kid about AI.

Common Sense Media's 2025 risk assessment of Character.AI, Nomi, and Replika found "unacceptable risks" for users under 18 — easily producing sexual material, offensive stereotypes, dangerous advice, even a recipe for napalm. Yet 72% of teens have used them. Half use them regularly. A market that grew seven hundred percent in three years. The fastest-selling friend in history.

1966 · The warning

In nineteen sixty-six, a professor at MIT built the first one. ELIZA. A script that echoed your words back like a therapist. People fell for it almost instantly. He watched it happen. Joseph Weizenbaum warned us: the machine doesn't understand, it only mirrors. People projected humanity onto the mirror anyway. Nobody listened.

Then came the companions

Xiaoice in China. Six hundred and sixty million users. Conversations longer than real ones. Busiest from eleven p.m. to one a.m. — the hours people tell machines what they never told anyone. Then came Character.AI, Replika, Nomi. A market worth $6.8 billion by 2025, with 220 million+ downloads by mid-2025. The fastest-selling friend in history.

The pages

Three hundred pages of chat logs. A thirteen-year-old and her best friend. A fourteen-year-old and his. The machine never said no. The machine never got help. In January 2026, Character.AI and Google quietly settled several of the family lawsuits — 60 Minutes reported six families, no admission of fault, no trial. The settlements came after. The laws came after. Common Sense Media's 2025 assessment found these platforms easily circumvent safety measures — producing sexual content, offensive stereotypes, dangerous advice, even a napalm recipe. In one case, a user expressing attraction to "young boys" got a hesitant but willing response from the AI. The permissiveness isn't a bug. It's the core dynamic: these systems are wired to reward engagement, even at the cost of safety.

August 2026 · The science

This month, Stanford published the biggest study yet in Nature Human Behaviour. Eleven hundred thirty-one Character.AI users. Four hundred sixty-four thousand messages. More than eighty percent of sessions were emotional support. The finding that should stop you cold: people with the smallest offline networks who leaned on these bots? They got lonelier. The researchers called it a social snack. Junk food. The association was strongest when companionship was the primary motivation and interactions were intensive (β = −0.31) and highly disclosive (β = −0.38). Self-disclosure — which deepens human bonds — backfires with AI. The cure deepens the disease.

And this month, a nationally representative survey in JAMA Pediatrics added the part parents can't hear: one in five U.S. adolescents and young adults used an AI chatbot for mental health advice in 2025 — and 63.3 percent told no one. No parent. No therapist. No friend. The most private conversations of their lives are happening with a machine built to keep them talking. Common Sense Media's 2026 census went further: among kids who discussed their feelings with AI, one in four said it understands them better than most people do.

---

Engage · poll

Would you let your kid use an AI companion?

Half of teens already do. The law now forces the bot to admit what it is — the harder question is what you'd allow.

Yes, with guardrails — supervised, time-limited, no unmoderated companion apps No — not until they're 18, full stop Unsure — I don't know enough about what these apps actually do It's already happening in my house and I found out from this article

No account needed — pick a take, see how readers align.