Character.ai Removes Teen Chat for Safety

In a significant shift for AI-driven entertainment, Character.ai is implementing changes to its platform that prioritize user safety, particularly for younger audiences. The company announced on October 29th that it will remove open-ended chat features for under-18 users, a move aimed at minimizing risks while maintaining engagement. This decision reflects a broader industry trend toward responsible AI deployment, where balancing innovation with protection is paramount. The rollout begins in the U.S. on November 24th, with other markets to follow shortly, underscoring a cautious approach to product evolution.

This change stems from extensive collaboration with safety experts and organizations dedicated to teen online wellbeing. Since the initial announcement, Character.ai has gathered input from partners like ConnectSafely, which brings deep expertise in safeguarding young users. Additionally, the company has initiated a new partnership with Koko to support long-term efforts in enhancing user welfare. By working closely with these stakeholders, Character.ai aims to align protocols that reduce disruption and ensure a thoughtful transition away from open-ended chat functionalities.

Ology for this rollout emphasizes a mindful, phased approach to minimize negative impacts on teen users. Character.ai is committed to offboarding teens from open-ended chat as thoughtfully as possible, focusing on clear communication and gradual implementation. This involves aligning on the best possible set of protocols to handle the product change, with a priority on user safety throughout the process. The company is also leveraging its partnerships to refine these strategies, ensuring that the transition is smooth and well-supported by expert guidance.

Of this initiative include a redesigned under-18 experience centered on non-chat features, such as interactive Feed, Imagine, Avatar FX, and Streams. These alternatives aim to provide fun and creative outlets for teens, demonstrating that the removal of open-ended chat does not eliminate engaging interactions. Character.ai has been actively building these features and is developing new experiences to be announced soon, reinforcing the belief that entertainment AI's future is multi-modal. This shift allows users to exercise creativity and build new worlds beyond traditional chat interfaces.

Of this change highlight Character.ai's commitment to evolving AI entertainment in a safety-conscious manner. By focusing on multi-modal experiences, the company addresses potential risks associated with open-ended interactions while fostering innovation in user engagement. This approach not only enhances wellbeing for under-18 users but also sets a precedent for how AI platforms can adapt to societal concerns. The ongoing work with partners ensures that these efforts are grounded in expert insights, potentially influencing broader industry standards for youth-focused AI applications.

Limitations of this rollout include the phased nature of the change, which may lead to varying user experiences across different markets. Character.ai acknowledges that the removal of open-ended chat is a significant adjustment for teens, and the company is working to minimize disruption through careful planning. However, the success of alternative features like interactive Feed and Avatar FX in fully replacing chat-based interactions remains to be seen as new experiences are developed and rolled out. Future announcements will provide further details on how these limitations are addressed in the evolving under-18 ecosystem.