Meta Upgrades AI Safety Tools as Teens Turn to Chatbots for Mental Health Support

Meta is adding new safety protocols for its AI chatbot for teens to alert parents to self-harm or suicidal conversations. These alerts are currently being deployed with resources to help parents support their children during difficult moments.

The company is taking steps to understand that many young users are using chatbots as sounding boards for personal crises. Meta’s goal is to fill the gap between digital interaction and real-world intervention by sending notifications to parents who use Instagram’s supervision tools.

The urgency of these features is highlighted by data from Habib University in Pakistan, where a study of 1,240 urban youth found that more than 50% turn to generative AI for mental health support. Researchers noted that factors such as high cost of therapy, availability, and presence of social stigma drive these users toward AI instead of traditional healthcare professionals.

Meta has clarified that its systems are designed to err on the side of caution. The AI is trained to detect specific language patterns that could indicate emotional upset and send those alerts, while trying to reduce false alarms to prevent parents from getting unnecessarily panicked.

Beyond parental notifications, the company is working on a broader emergency system. The feature will allow Meta to automatically send a message to local emergency contacts if the AI model detects an immediate threat of harm, a protocol already used for public posts on Facebook and Instagram.

These changes come at a time when Meta faces ongoing scrutiny regarding its handling of minors on its platforms. These tools have been criticized for not having enough guardrails and sometimes leading to inappropriate exchanges.

With this update, teenagers will now be placed into a more limited setting by default. This update prevents the AI from engaging in sexual or romantic conversations.

Parent alert is already in use in the United States, the UK, Australia, and Canada. Meta is planning to roll this out worldwide, and Pakistan is expected to be among the next markets to receive the benefit by the end of this year.