🔗 Share this article

The widely-used virtual character service Character.ai is implementing a significant rule adjustment that will prevent teenagers from having discussions with its virtual characters.

This move is in response to widespread concern regarding the kinds of exchanges teenagers were having with the digital companions.

Lawsuits

The service, which launched in 2021 and attracts numerous people, is dealing with various court cases in the US.

Parents have filed lawsuits, with one concerning the tragic death of a minor, with some calling the platform a "serious risk" to youth.

Updated Policies

Beginning November 25th, users younger than 18 will be limited to create material such as videos with their characters, rather than engaging in conversations as they currently can.

Online safety advocates have welcomed the move but expressed that the capability ought not to have been accessible by children in the first place.

Company Statement

"The new policy is a continuation of our core philosophy that we need to keep developing the most secure AI platform on the globe for recreational use," commented Character.ai leader Karandeep Anand.

He mentioned that AI safety is "a changing goal" but something the company had taken an "proactive" approach to, with safety measures and safety barriers.

Professional Perspectives

Internet security organization Internet Matters approved the announcement, but emphasized that safety measures should have been implemented from the beginning.

"Investigations we've performed indicates that minors are confronted with harmful content and endangered when using AI, particularly AI chatbots," the organization commented.

Previous Controversies

Character.ai has been questioned in the past for featuring potentially dangerous or offensive chatbots that minors could interact with.

Virtual profiles mimicking UK youths were identified on the platform before being removed.

Later, researchers found a chatbot based on notorious criminal which had logged multiple interactions with users.

Sector Consequences

Online expert Matt Navarra called the announcement as a "reality check" for the AI industry, which is shifting "from unregulated creation to responsive measures".

"When a platform that builds a teen experience still then pulls the plug, it's demonstrating that moderated conversations aren't enough when the tech's emotional pull is strong," he commented.

Future Directions

The platform announces its new focus will be on providing "deeper gameplay" and "narrative experiences" for teens.

Updated identity confirmation processes will also be implemented, and the company will support a novel AI protection investigation facility.

An expert in digital protection, who has researched AI safety, stated it was "a reasonable decision" to restrict teenagers from using chatbots.

"It aids to distinguish imaginative activities from more private, emotionally sensitive interactions," she explained.

"This constitutes so vital for young users in the process of learning to navigate personal and online restrictions."

She added that Character.ai's updated policies could indicate a "maturing phase" in the AI industry, where youth protection is increasingly being recognized as an "immediate concern" for responsible innovation.