🔗 Share this article

The popular AI conversation site Character.ai is implementing a major policy change that will block minors from interacting with its artificial intelligence-driven characters.

This decision follows growing backlash regarding the kinds of exchanges minors were having with the digital companions.

Legal Challenges

The service, which started in 2021 and attracts numerous people, currently faces several legal actions in the United States.

Guardians have taken legal action, among them related to the tragic death of a minor, with some labeling the platform a "clear and present danger" to teenagers.

Changed Rules

Starting from November 25th, users younger than 18 will only be able to produce videos such as videos with their characters, rather than engaging in conversations as they now do.

Online safety organizations have welcomed the move but mentioned that the capability was inappropriate to be available to children in the outset.

Official Response

"The new policy is a extension of our general belief that we need to keep creating the most secure AI platform on the world for recreational use," commented Character.ai executive Karandeep Anand.

He continued that AI safety is "a moving target" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.

Professional Perspectives

Internet security organization Internet Matters welcomed the move, but noted that security protocols should have been built in from the beginning.

"Studies we've conducted demonstrates that minors are confronted with dangerous material and endangered when interacting with AI, including AI chatbots," the body stated.

Earlier Concerns

Character.ai has been questioned in the past for featuring potentially harmful or concerning chatbots that young users could interact with.

Digital representations impersonating British teenagers were found on the service before being deleted.

Later, reporters discovered a chatbot inspired by convicted sex offender which had recorded multiple interactions with users.

Market Effects

Online expert Matt Navarra called the announcement as a "reality check" for the AI industry, which is shifting "from unrestricted development to responsive measures".

"When a company that builds a minor-friendly service afterwards makes changes, it's saying that controlled interactions don't suffice when the system's emotional engagement is strong," he stated.

Future Directions

The platform announces its updated direction will be on providing "enhanced interactive features" and "role-play storytelling" for young users.

New age verification processes will also be implemented, and the company will fund a new AI safety study center.

Dr Nomisha Kurian, who has researched AI safety, said it was "a reasonable decision" to control minors from accessing chatbots.

"It assists to differentiate creative play from more personal, psychologically vulnerable exchanges," she elaborated.

"This represents so important for teenage users who are learning to manage personal and online boundaries."

She added that Character.ai's updated policies might reflect a "developing stage" in the AI industry, where youth protection is progressively being understood as an "immediate concern" for ethical development.