Post Thumbnail

Data up to 2022 became “pre-nuclear steel” for AI training

Artificial intelligence, intended to become the locomotive of technological progress, is beginning to slow down its own development. According to The Register, generative models have filled the internet with so much synthetic content that this creates a real technological dead end.

And we observe the formation of a “digital vicious circle”. New AI models are increasingly trained on materials created by previous AI versions. The result resembles the classic game of “telephone”. Where each subsequent participant passes on increasingly distorted information. In professional circles, this scenario received the name “model collapse”.

A striking analogy emerges with pre-nuclear steel! Just as metal produced before the first nuclear tests in July 1945 is valued for the absence of radionuclides, data up to 2022 becomes an invaluable resource due to minimal “contamination” by synthetic content.

Maurice Chiodo, research fellow at the Centre for Existential Risk Studies at Cambridge University, emphasizes: access to “clean data” is critically important for preventing model degradation.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
XPeng introduced world's first female humanoid robot

Chinese electric car manufacturer XPeng introduced the new generation humanoid robot IRON. And this is the first female humanoid!

Michael Burry bet 1.1 billion dollars against Nvidia and Palantir

Michael Burry - this is a legendary investor who predicted the 2008 mortgage crisis. And now he's making a loud move again. Michael bet 1.1 billion dollars in put options against 2 major companies from the AI sector. These are Nvidia and Palantir.

Anthropic conducts interviews with models before sending to retirement

Anthropic published a policy for "decommissioning" outdated AI versions. Key commitment is to preserve weights of all public and actively used internal models for at least the company's lifetime. So that in the future access can be restored if necessary.

Nvidia head believes there is no AI bubble

Nvidia founder Jensen Huang dispelled concerns about a bubble in the AI market. And according to him, the company's latest chips are expected to bring 0.5 trillion dollars in revenue.

Sam Altman is tired of money questions

Sam Altman is tired of questions about OpenAI's money. And this became obvious during a joint interview with Satya Nadella on the Bg2 podcast.