Japanese laboratory created AI that thinks like a human brain

Post Thumbnail

Imagine how the human brain works. It does not produce instant answers like modern artificial intelligence systems. Japanese scientists from the SakanaAI laboratory have created a system that brings artificial intelligence closer to natural thinking processes.

The system was named Continuous Thought Machine, or CTM. Unlike standard neural networks, it is not limited to 1 attempt to find a solution. Instead, CTM can process information multiple times, using what researchers call “thinking ticks.”

The principle of CTM can be explained through the process of solving a complex problem. The brain processes information gradually. First, some areas are activated, then others connect. CTM works similarly. It can perform from 5 to 50 iterations of data processing before forming a final answer.

The system is based on unusual artificial neurons. Each of them is not a simple formula, but a full-fledged multilayer MLP network. Capable of storing the history of its previous states. This creates a kind of computation log, allowing the system to analyze intermediate results.

The key feature of CTM is the synchronization of neurons. As in a symphony orchestra, not only the play of individual musicians is important, but also their joint sound, so in neural processes, the coherence of activation of different areas is critical. A special synchronization matrix in CTM tracks these neural “consonances.”

Practical tests confirm the effectiveness of the new architecture. CTM demonstrates high results when working with databases. It also successfully copes with maze navigation tasks, often surpassing traditional approaches. Link to the interactive presentation of the system in the description.

Perhaps this is one of the first mechanisms of step-by-step information comprehension that significantly brings the work of a neural network closer to biological principles of thinking. Where a system of multiple iterations of data processing works, a mechanism for preserving the history of neuron states and a matrix for tracking their synchronous operation. Such a combination is absent in existing architectures.

Почитать из последнего
UBTech will send Walker S2 robots to serve on China's border for $37 million
Chinese company UBTech won a contract for $37 million. And will send humanoid robots Walker S2 to serve on China's border with Vietnam. South China Morning Post reports that the robots will interact with tourists and staff, perform logistics operations, inspect cargo and patrol the area. And characteristically — they can independently change their battery.
Anthropic accidentally revealed an internal document about Claude's "soul"
Anthropic accidentally revealed the "soul" of artificial intelligence to a user. And this is not a metaphor. This is a quite specific internal document.
Jensen Huang ordered Nvidia employees to use AI everywhere
Jensen Huang announced total mobilization under the banner of artificial intelligence inside Nvidia. And this is no longer a recommendation. This is a requirement.
AI chatbots generate content that exacerbates eating disorders
A joint study by Stanford University and the Center for Democracy and Technology showed a disturbing picture. Chatbots with artificial intelligence pose a serious risk to people with eating disorders. Scientists warn that neural networks hand out harmful advice about diets. They suggest ways to hide the disorder and generate "inspiring weight loss content" that worsens the problem.
OpenAGI released the Lux model that overtakes Google and OpenAI
Startup OpenAGI released the Lux model for computer control and claims this is a breakthrough. According to benchmarks, the model overtakes analogues from Google, OpenAI and Anthropic by a whole generation. Moreover, it works faster. About 1 second per step instead of 3 seconds for competitors. And 10 times cheaper in cost per processing 1 token.