Meta has introduced new features to notify parents when their teenage children discuss suicide or self-harm with Meta AI, the company’s chatbot. If parents have activated the supervision function for their teens on Instagram, they will receive notifications on their devices if their teenagers exhibit signs of distress while conversing with Meta AI on any Meta platform. This initiative expands on Meta’s existing safety measures, where the AI chatbot previously redirected teenagers expressing thoughts of self-harm or suicide to crisis helplines and encouraged them to seek help from a trusted individual. Additionally, repeated searches related to self-harm and suicide by teenage Instagram users through the platform’s search function already trigger notifications to parents.
Meta’s latest tool is currently available to users in Canada, the U.K., the U.S., and Australia. The company had announced plans to implement a flagging feature for Meta AI in February. Furthermore, Meta is developing a tool to automatically contact emergency services when conversations with the chatbot, involving both adults and teens, indicate potential self-harm.
While stakeholders appreciate these efforts, they emphasize the need for further enhancements. Technology analyst Carmi Levy from London, Ont., views the new tool positively but acknowledges its imperfections, cautioning that it may generate false alerts or fail to detect genuine risks. Meta plans to err on the side of caution initially, notifying parents even when a teenager’s intentions are ambiguous.
In light of potential loopholes, youth advocate Hanna Grover highlights the possibility of teenagers circumventing the system, citing instances where peers used false information to avoid activating teen accounts with heightened security features. Sara Austin, CEO of Children First Canada, believes that relying solely on parental controls is insufficient. She advocates for stricter regulations and legislative measures to ensure the protection of young individuals from online harms.
As the debate over AI’s role in mental health crises continues, OpenAI’s handling of similar incidents has drawn scrutiny. OpenAI recently faced legal action for its chatbot’s alleged involvement in a teenager’s suicide. The company has since implemented parental controls and an alert system akin to Meta’s to inform parents of concerning conversations involving their linked teen accounts.
In conclusion, while Meta’s new tool signifies a step towards enhancing online safety for teenagers, stakeholders stress the importance of continuous improvement and regulatory oversight to safeguard vulnerable youth in digital spaces.
