Post Thumbnail

GigaChat lost to Claude and Gemini in Russian language on MERA benchmark

Testing GigaChat reveals the harsh truth about Russia’s place in the global artificial intelligence race. Recent tests on the MERA benchmark showed results that force serious reflection. The Russian model, created specifically for working with Russian language, unexpectedly lost to foreign competitors in its own “native element”.

Particularly noteworthy is that the tests were conducted by the GigaChat team itself on a specialized task set developed by the domestic Alliance in the field of artificial intelligence. In comparative tests, the American models Claude 3.7 Sonnet, Gemini 2.0 Flash, Gemini 1.5 Pro. As well as the Chinese DeepSeek-V3 and DeepSeek-V3.0324 demonstrated higher performance.

Jack Clark, co-founder and head of policy at Anthropic, and formerly director of policy at OpenAI, gave an unambiguous assessment of the situation. In his opinion, if GigaChat reflects the state of the entire Russian language model ecosystem, then the country will not only be unable to compete at the cutting edge, but will also face difficulties even in the niche of small open models.

The data from this testing was published in a scientific paper on arxiv. These results indicate that the struggle for leadership in artificial intelligence remains a battle only between the USA and China.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.

Latest News

Grok 4 scored 57% in "The Last Exam" versus 22% for Gemini 2.5 Pro

Elon Musk presented a new version of his neural network – Grok 4. The maximum version – Grok 4 Heavy – can run multiple computations simultaneously and scores 57% in the most difficult test "The Last Exam of Humanity". For comparison, the previous leader Gemini 2.5 Pro showed only 22%.

Researchers found AI vulnerability through facts about cats

I was mildly surprised by this news. Do you know that an ordinary mention of cats can confuse the most advanced artificial intelligence models? Scientists discovered an amazing vulnerability in neural networks' thinking processes.

US IT companies fired 94,000 employees in six months due to AI

In the first half of 2025, American IT companies fired more than 94,000 technical specialists. This is not just cost-cutting. This is structural change under the influence of artificial intelligence.

OpenAI hired the first psychiatrist in the AI industry to study ChatGPT's impact on the psyche

OpenAI company announced that it hired a professional clinical psychiatrist with experience in forensic psychiatry. To research the impact of its artificial intelligence products on users' mental health.

Historic milestone: Amazon's millionth robot delivered to Japan

Amazon reached a historic milestone! And after 13 years of implementing robots in its warehouse facilities, the company announced reaching the mark of 1 million robotic devices. The millionth robot was recently delivered to an Amazon warehouse in Japan.