🔗 Share this article

The well-known virtual character service Character.ai is introducing a significant policy change that will stop minors from interacting with its artificial intelligence-driven avatars.

This action is in response to intense criticism regarding the kinds of exchanges young people were having with the virtual friends.

Legal Pressure

The service, which launched in 2021 and has millions of users, is confronting multiple lawsuits in the America.

Parents have filed lawsuits, with one involving the tragic death of a young person, with some calling the platform a "immediate threat" to teenagers.

Changed Rules

Starting from November 25th, users under 18 will only be able to create material such as videos with their characters, instead of engaging in conversations as they currently can.

Online safety campaigners have applauded the decision but expressed that the feature should never have been offered to children in the outset.

Company Statement

"Today's announcement is a extension of our fundamental approach that we need to keep creating the safest AI platform on the globe for leisure activities," stated Character.ai executive Karandeep Anand.

He continued that AI safety is "a changing goal" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Expert Opinions

Digital protection body Internet Matters welcomed the move, but emphasized that safety measures ought to have been implemented from the start.

"Our research demonstrates that young people are subjected to harmful content and put at risk when using AI, such as AI chatbots," the body stated.

Earlier Concerns

Character.ai has been challenged in the past for featuring potentially dangerous or offensive chatbots that young users could talk to.

Virtual profiles impersonating UK youths were identified on the service before being removed.

Later, investigative journalists discovered a chatbot modeled after convicted sex offender which had logged numerous conversations with users.

Industry Impact

Digital platform expert Matt Navarra called the situation as a "reality check" for the AI industry, which is shifting "from unregulated creation to reactive controls".

"When a company that builds a minor-friendly service afterwards pulls the plug, it's indicating that filtered chats aren't enough when the tech's emotional pull is intense," he stated.

Future Directions

Character.ai says its revised approach will be on providing "deeper gameplay" and "character-driven stories" for teenagers.

Updated identity confirmation systems will also be introduced, and the organization will fund a novel AI protection research lab.

An AI safety researcher, who has researched AI safety, commented it was "a sensible move" to limit teens from interacting with chatbots.

"It assists to distinguish imaginative activities from more personal, psychologically vulnerable exchanges," she clarified.

"This constitutes so crucial for teenage users who are learning to manage emotional and digital restrictions."

She continued that Character.ai's new measures might reflect a "maturing phase" in the AI industry, where minor security is increasingly being recognized as an "urgent priority" for accountable advancement.