There is a growing concern over the interaction of young individuals with AI chatbots, prompting Meta to introduce new tools for parents to monitor their children’s conversations. Some provinces are also contemplating banning the use of AI chatbots for young people altogether.
Parents utilizing Meta’s Teen Accounts supervision feature across Facebook, Instagram, and Messenger can now track the topics and categories their children have engaged with using the AI chatbot in the past week. For instance, they can review discussions under “health and well-being” to check for mentions of fitness, physical health, or mental wellness.
Meta is working on alerts to inform parents if their teenagers attempt to talk about suicide or self-harm with the chatbot.
Meanwhile, provincial authorities are taking steps to restrict the use of AI chatbots. Manitoba recently announced plans to prohibit youths from accessing AI chatbots and social media platforms. In a similar vein, B.C. Attorney General Niki Sharma mentioned that if federal safeguards on AI chatbots and social media for youth are lacking, the provincial government may consider implementing its own regulations.
Legal Actions Targeting AI Developers
There are mounting worries that prolonged use of AI chatbots could pose mental health hazards, particularly among younger users, leading to increased scrutiny on the technology companies creating these chatbots.
Following the tragic Tumbler Ridge, B.C., shooting that claimed eight lives, families of the victims have filed a lawsuit against OpenAI, alleging that the company did not alert authorities despite being aware of disturbing content shared by the shooter with ChatGPT.
OpenAI has stated that it has already enhanced its safety measures, including improving how ChatGPT handles distress signals.
Another lawsuit filed by the parents of a 16-year-old, Adam Raine, asserts that the use of ChatGPT contributed to their son’s suicide.
Manitoba Premier Wab Kinew says he wants to ban social media and artificial intelligence chatbots for youth. But would this plan keep youth healthier and safer? CBC reporter Bryce Hoye investigates.
Chatbots Designed for Engagement, Not Support
Concerns extend beyond tragic outcomes to potential risks associated with specific uses of AI chatbots. Research indicates that using chatbots for mental health support may carry risks, as AI’s tendency to validate users’ viewpoints could support disordered thinking, especially in prolonged conversations.
Darja Djordjevic, a psychiatrist based in New York, co-authored a recent risk assessment on the use of chatbots for mental health support. She cautions against using chatbots for mental health support currently, citing safety issues observed in systems like ChatGPT, Claude, Gemini, and Meta AI, particularly concerning young individuals.
