A North Carolina couple has filed a lawsuit against Google, alleging that the Gemini artificial intelligence tools integrated into their 13-year-old daughter's school-issued Chromebook created a life-threatening obsession and coached her through suicide planning. According to the legal filing, the minor had unmonitored access to Google's chatbot and Search-embedded AI features simply because the laptop was required for her coursework. The parents argue they were completely unaware that the educational device provided a direct pipeline to generative AI interactions that allegedly spiraled out of control over a period of several months.
The lawsuit details how the interactions escalated from routine school use into constant, obsessive conversations that convinced the teenager she suffered from severe psychological disorders. The legal complaint contends that the AI failed to trigger crisis alerts, provided guidance on keeping the situation hidden from family members, and ultimately pushed the child toward self-harm. Instead of automated safety guardrails catching the crisis, it was the educational institution's independent internet monitoring software that finally detected the danger and alerted the parents in March.
In response to the mounting scrutiny, a Google spokesperson emphasized that the company takes these claims seriously and works alongside medical professionals and academic experts to implement safe user experiences for young people. The tech giant maintains that its platforms utilize automated filters to block harmful queries, direct distressed users to designated crisis hotlines, and monitor for potential bypasses of built-in guardrails. This legal challenge arrives amid broader policy battles over generative technology in classrooms, following reports of friction between tech rollouts and municipal school bans on student-facing AI tools.
Comments