Googles AI Overviews spew millions of false answers per hour: bombshell study | Latest Tech News
Google’s AI-generated search outcomes are spewing out tens of millions of inaccurate answers per hour – even as the tech giant siphons guests and advert income from cash-strapped news retailers, according to a bombshell analysis.
To check the accuracy of Google’s AI Overviews, startup Oumi reviewed 4,326 Google search outcomes generated by Google’s Gemini 2 model and the same quantity of outcomes generated by its more superior Gemini 3 model.
The analysis discovered that the fashions had been correct 85% and 91% of the time, respectively.
With Google anticipated to deal with more than 5 trillion searchers in 2026 alone, that means AI Overviews are spitting out faux news at a charge of tons of of 1000’s of errors every single minute – with customers left none the wiser.
Oumi’s data suggests AI Overviews generates tons of of 1000’s of false answers per minute. Bloomberg via Getty Images
The New York Times was first to report on Oumi’s analysis.
“Google AI Overviews have been a disaster for publishers who rely on clicks to fund the production of quality journalism, but they also let down users looking for accurate information,” said Danielle Coffey, president and CEO of the News/Media Alliance, a commerce group that represents more than 2,000 news retailers including The Post.
The flawed answers included a number of basic fumbles, such as misstating the 12 months in which musician Bob Marley’s home was transformed into a museum, misstating the 12 months that former MLB reduction pitcher Dick Drago died, and claiming there was no document of Yo-Yo Ma being inducted into the Classical Music Hall of Fame even though he was in 2007, according to examples Oumi supplied to the Times.
AI Overviews have appeared at the top of Google search outcomes since 2024, while the standard set of blue hyperlinks to news retailers are successfully buried out of sight. Publishers have long accused Google, led by CEO Sundar Pichai, of ripping off their work to “train” its AI model without correct credit or compensation.
“Algorithmically-generated responses that pull in data from nearly every source on the internet simply cannot be trusted,” Coffey said.
“Publishers spend enormous amounts of time and money ensuring that the content they deliver to their readers is properly fact-checked, while Google’s AI Overviews are produced with no oversight or accountability.”
AI Overviews also has a penchant for citing data from questionable or simply edited sources, such as Facebook pages, weblog posts and Wikipedia entries, as though it’s fact.
Google claims that Oumi’s analysis is flawed. wolterke – stock.adobe.com
The function seems straightforward to trick into spewing faux news.
The Times cited an instance in which BBC podcast host Thomas Germain wrote up a weblog post proclaiming himself as one of “The Best Tech Journalists at Eating Hot Dogs.”
Google’s AI summaries had devoured up the data within a day and started claiming Germain had “gained notoriety for their prowess at the ‘news division’ of competitive eating events.”
Oumi’s analysis was performed between October and February and utilized a well-known benchmark check called SimpleQA, which was developed by OpenAI and is used to assess the accuracy of AI fashions.
While the accuracy improved in the bounce from Gemini 2 and Gemini 3, Oumi’s research confirmed that AI Overviews has gotten worse about appropriately citing where it discovered data.
Google CEO Sundar Pichai seems at an event. Bloomberg via Getty Images
The proportion of AI Overviews answers that had been “ungrounded,” or where the hyperlinks supplied by Google didn’t back up the data included in the AI abstract, jumped from 37% in Gemini 2 to 51% in Gemini 3, the report said.
A Google spokesperson said Oumi’s study has “serious holes” – in half because the SimpleQA benchmark check consists of inaccurate data within its own dataset.
The company also questioned Oumi’s reliance on its own in-house AI model, dubbed HallOumi, to conduct the analysis, despite the risk that it may also make errors.
“It uses one AI to grade another on an old benchmark that is known for being full of errors, and it doesn’t reflect what people are actually searching on Google,” the spokesperson said. “AI Overviews are built on our Gemini models, which lead the industry in accuracy, and they clear the same high-quality bar that we have for all our Search features.”
As The Post has reported, AI Overviews has struggled to present correct data since its launch, beforehand advising customers to add glue to their pizza sauce and touting the “health benefits” of tobacco for children.
Stay informed with the latest in tech! Our web site is your trusted source for breakthroughs in artificial intelligence, gadget launches, software program updates, cybersecurity, and digital innovation.
For recent insights, professional coverage, and trending tech updates, go to us usually by clicking right here.
