BBC and European Union found errors in 45% of AI assistants’ answers
The European Broadcasting Union and BBC checked answers of popular AI-based assistants. And the results are, to put it mildly, not impressive. 45% of answers contain serious errors, and 81% have some problems.
Researchers from 22 media organizations also analyzed 3,000 answers from ChatGPT, Copilot, Gemini and Perplexity in 14 languages. A third of answers showed serious problems with sources. They were either missing or incorrect. Gemini had problems with sources found in 72% of cases at all. For other assistants this figure is below 25%, but that’s also not encouraging.
For their part, OpenAI and Microsoft acknowledged the existence of hallucinations when the model outputs incorrect information, and say they’re working on fixes. And Perplexity claims their “Deep Research” mode is 93.9% accurate.
What bothers me about this report – are the researchers themselves and their bias. Specifically BBC has been repeatedly caught distorting information. And rallies repeatedly took place in front of their London office, you can search Google. Also, European publishers are currently in conflict with Google – and already Google’s Gemini is the worst.
Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
UBTech will send Walker S2 robots to serve on China's border for $37 millionChinese company UBTech won a contract for $37 million. And will send humanoid robots Walker S2 to serve on China's border with Vietnam. South China Morning Post reports that the robots will interact with tourists and staff, perform logistics operations, inspect cargo and patrol the area. And characteristically — they can independently change their battery.
AI chatbots generate content that exacerbates eating disordersA joint study by Stanford University and the Center for Democracy and Technology showed a disturbing picture. Chatbots with artificial intelligence pose a serious risk to people with eating disorders. Scientists warn that neural networks hand out harmful advice about diets. They suggest ways to hide the disorder and generate "inspiring weight loss content" that worsens the problem.
OpenAGI released the Lux model that overtakes Google and OpenAIStartup OpenAGI released the Lux model for computer control and claims this is a breakthrough. According to benchmarks, the model overtakes analogues from Google, OpenAI and Anthropic by a whole generation. Moreover, it works faster. About 1 second per step instead of 3 seconds for competitors. And 10 times cheaper in cost per processing 1 token.
