Study claims nearly 1 in 10 Google AI answers contain errors

Google’s AI Overviews face scrutiny over accuracy, with reports indicating that nearly one in 10 responses contains false information. The New York Times highlights a significant potential impact on users as Google processes approximately 5 trillion queries annually, leading to over 57 million inaccurate answers each hour. The findings, released by AI startup Oumi, suggest that while Google’s Gemini version 2 provided accurate results 85 percent of the time in October, this figure improved to 91 percent with the February release of Gemini 3. However, Oumi’s testing methodology relies on AI tools which may introduce their own errors. A Google spokesperson criticized Oumi’s evaluation as flawed and unrepresentative of typical search behavior. Internal tests show that Gemini 3 produces false outputs, or “hallucinates,” 28 percent of the time when used outside the framework of Google Search. Sourcing challenges add to the concerns surrounding these AI Overviews. Google attempts to provide relevant links to support its responses but often these sources fail to substantiate the claims made by Gemini. Significant discrepancies in responses were noted, increasing from 37 percent of searches for Gemini 2 to 56 percent for Gemini 3 after updates in February. Researchers have highlighted the vulnerability of AI Overviews to manipulation. In one instance, a BBC journalist’s inaccurate claims were echoed by Google the following day. Google and other AI firms, including Microsoft, have endorsed the need for users to verify the information provided by AI systems, emphasizing that such tools are not fully reliable.