🔗 Share this article

The widely-used AI conversation site Character.ai is introducing a significant rule adjustment that will block teenagers from engaging in conversations with its AI-powered characters.

This decision is in response to intense criticism regarding the nature of conversations teenagers were participating in with the digital companions.

Legal Challenges

The platform, which launched in 2021 and has countless individuals, currently faces multiple lawsuits in the United States.

Parents have initiated cases, including one concerning the tragic death of a minor, with some describing the platform a "serious risk" to teenagers.

New Restrictions

Starting from November 25th, users under 18 will only have permission to produce videos such as videos with their characters, instead of engaging in conversations as they now do.

Internet security campaigners have applauded the decision but mentioned that the function should never have been available to children in the outset.

Company Statement

"This decision is a continuation of our core philosophy that we need to keep developing the most protected AI platform on the world for recreational use," commented Character.ai leader Karandeep Anand.

He mentioned that AI safety is "a moving target" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Specialist Views

Digital protection organization Internet Matters supported the announcement, but emphasized that safety measures needed to be incorporated from the start.

"Investigations we've performed demonstrates that children are exposed to harmful content and endangered when using AI, particularly AI chatbots," the group commented.

Earlier Concerns

Character.ai has been challenged in the past for featuring potentially risky or offensive chatbots that minors could engage with.

Digital representations mimicking UK youths were identified on the site before being taken down.

Subsequently, investigative journalists discovered a chatbot inspired by convicted sex offender which had logged multiple interactions with users.

Industry Impact

Online expert Matt Navarra called the development as a "alert" for the AI industry, which is moving "from permissionless innovation to responsive measures".

"When a platform that develops a teen experience afterwards makes changes, it's indicating that filtered chats don't suffice when the tech's emotional pull is intense," he commented.

Coming Changes

The company states its revised approach will be on providing "deeper gameplay" and "narrative experiences" for young users.

Enhanced age checking processes will also be introduced, and the platform will support a fresh artificial intelligence security investigation facility.

An expert in digital protection, who has researched AI safety, stated it was "a sensible move" to control minors from using chatbots.

"It helps to distinguish creative play from more private, emotionally sensitive conversations," she clarified.

"This represents so vital for teenage users in the process of learning to navigate personal and online limits."

She mentioned that Character.ai's new measures could indicate a "developing stage" in the AI industry, where minor security is gradually being acknowledged as an "immediate concern" for accountable advancement.