The company confirmed that all flagged conversations will undergo manual review before an alert is dispatched to parents through Instagram’s Parental Supervision tools. By erring on the side of caution, Meta aims to identify clear references to self-harm, even in instances where a teen's intent remains ambiguous. This update is currently active for users in the U.S., U.K., Australia, and Canada, with a full global rollout expected by the end of the year.
Meta to Alert Parents Over Teen AI Chats Involving Self-Harm
Meta is introducing automated parental notifications when teenagers discuss suicide or self-harm with the company’s AI chatbot. The move signals a shift in how the tech giant handles crisis intervention, balancing user privacy against mounting pressure from regulators and families concerned about the safety of minors interacting with generative AI.
Beyond alerts, Meta is expanding its "Limited Content" setting to include the chatbot, effectively restricting the types of prompts the AI will address with minors. The company is also bridging the gap between social media content and private interactions by extending its existing emergency response protocol to chatbot conversations. If a user of any age indicates an immediate risk of suicide during an AI exchange, Meta intends to contact emergency services, mirroring the safety measures already in place for public posts on Facebook and Instagram.
Comments (0)
No comments yet. Be the first!