🔗 Share this article

The widely-used chatbot platform Character.ai is implementing a major restriction that will prevent minors from having discussions with its artificial intelligence-driven avatars.

This decision comes after intense criticism regarding the kinds of exchanges teenagers were engaging in with the AI entities.

Legal Challenges

The platform, which was founded in 2021 and is used by millions of users, currently faces multiple lawsuits in the US.

Guardians have taken legal action, including one involving the loss of a teenager, with some labeling the platform a "serious risk" to young people.

New Restrictions

Effective November 25th, users under 18 will only be able to generate content such as videos with their characters, as opposed to chatting as they currently can.

Digital protection advocates have welcomed the move but stated that the feature ought not to have been accessible by young users in the beginning.

Company Statement

"This decision is a part of our core philosophy that we need to keep building the most protected AI platform on the world for entertainment purposes," stated Character.ai leader Karandeep Anand.

He added that AI safety is "a moving target" but something the company had taken an "proactive" approach to, with guardian features and preventive measures.

Expert Opinions

Digital protection body Internet Matters welcomed the move, but stressed that protective features needed to be implemented from the beginning.

"Our research indicates that minors are subjected to harmful content and put at risk when engaging with AI, including AI chatbots," the body said.

Earlier Concerns

Character.ai has been questioned in the past for including potentially harmful or concerning chatbots that minors could interact with.

Virtual profiles impersonating British teenagers were found on the service before being removed.

Afterwards, researchers found a chatbot inspired by notorious criminal which had recorded multiple interactions with users.

Market Effects

Social media expert Matt Navarra characterized the development as a "reality check" for the AI industry, which is shifting "from unregulated creation to responsive measures".

"If a service that creates a teen experience afterwards pulls the plug, it's indicating that moderated conversations don't suffice when the system's emotional engagement is intense," he stated.

Next Steps

Character.ai says its new focus will be on providing "more immersive experiences" and "narrative experiences" for teenagers.

Enhanced age checking systems will also be implemented, and the company will support a novel AI protection research lab.

An AI safety researcher, who has researched AI safety, stated it was "a prudent action" to control teenagers from accessing chatbots.

"It assists to differentiate imaginative activities from more personal, personally delicate exchanges," she explained.

"This is so important for young users still learning to handle emotional and digital limits."

She mentioned that Character.ai's new measures may represent a "maturing phase" in the AI industry, where minor security is increasingly being recognized as an "immediate concern" for ethical development.