US senators ask Google to explain AI tools in schools

The senators asked why Google made AI integrations defaults on education devices and why, in some cases, they could not be disabled.[2] They also asked whether school districts, teachers or parents had raised concerns about children’s academic or emotional reliance on AI.[2] Other questions seek details about support Google provided to districts concerned that its products were harming students, resources for districts and educators adopting its tools, and programs promoting school AI adoption, including their cost.[2] The letter requests explanations from the company; the evidence does not establish that Google has answered.

The senators asked whether Google had identified classroom AI tools that encouraged harmful behavior or emotional dependence in minors, or failed to recognize signs of suicidal or self-harm ideation.[2] They also asked how Google seeks to prevent chatbots from engaging in sycophantic or emotional conversations with children.[2] The letter asks what Google did after its researchers published a paper on the ethics of advanced AI assistants.[2] These are questions posed to the company, not findings that Google’s tools caused the harms described.

The senators’ letter says more than 150 million students worldwide use Google Classroom and that 93% of US school districts planned to purchase Chromebooks in 2025.[2] It says Google integrated AI features into Chromebooks, Google Classroom and software partnerships, often without extra controls to turn them off.[2] The letter cites a Wall Street Journal report based on interviews with more than 60 teachers, parents, students and clinicians.[1] It also cites an Economist survey of 20,000 students, reporting that AI users earned higher grades on average but had test scores 20% lower.[1]

Google announced a plan to turn off AI tools for K–12 students early the following year unless administrators enabled them.[4] The planned restrictions would also remove student access to Google Search at schools that blocked AI entirely.[4] That detail matters for school leaders assessing the plan: the letter’s questions about control and safety sit alongside a potential change to students’ access to Search. The evidence describes the plan, but does not establish its current status or how schools have responded.