Post Thumbnail

MIT creates breakthrough system for AI model optimization

Researchers at the Massachusetts Institute of Technology (MIT) have presented an innovative automated system that allows radically increasing the efficiency of artificial intelligence models through simultaneous use of two types of data redundancy.

The new development aims to solve one of the key problems of modern deep learning – high energy consumption of AI models when processing complex data structures in applications such as medical image analysis and speech recognition.

Existing algorithm optimization methods typically allow developers to use either sparsity or data symmetry – two different types of redundancy present in deep learning structures. MIT’s innovative approach allows utilizing both types simultaneously, which in experiments led to an increase in computation speed by almost 30 times.

“For a long time, accounting for these data redundancies required significant implementation efforts. Now a scientist can describe the desired computation result to our system in a more abstract way, without specifying the exact algorithm,” explains Willow Ahrens, an MIT postdoc and co-author of the study, which will be presented at the International Symposium on Code Generation and Optimization.

A key advantage of the system is the use of a convenient programming language, making it accessible for a wide range of applications. This is especially important for scientists who are not experts in deep learning but seek to increase the efficiency of AI algorithms in data processing.

MIT’s development opens new perspectives in optimizing computational resources for machine learning, offering:
– Automatic algorithm optimization considering multiple types of redundancy
– Significant reduction in computational power requirements
– Reduction in bandwidth and data storage costs
– Simplified interface for AI system developers

The system also has potential applications in scientific computing, which may contribute to accelerating research in various fields of science where complex computational models are used.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
UBTech will send Walker S2 robots to serve on China's border for $37 million

Chinese company UBTech won a contract for $37 million. And will send humanoid robots Walker S2 to serve on China's border with Vietnam. South China Morning Post reports that the robots will interact with tourists and staff, perform logistics operations, inspect cargo and patrol the area. And characteristically — they can independently change their battery.

Anthropic accidentally revealed an internal document about Claude's "soul"

Anthropic accidentally revealed the "soul" of artificial intelligence to a user. And this is not a metaphor. This is a quite specific internal document.

Jensen Huang ordered Nvidia employees to use AI everywhere

Jensen Huang announced total mobilization under the banner of artificial intelligence inside Nvidia. And this is no longer a recommendation. This is a requirement.

AI chatbots generate content that exacerbates eating disorders

A joint study by Stanford University and the Center for Democracy and Technology showed a disturbing picture. Chatbots with artificial intelligence pose a serious risk to people with eating disorders. Scientists warn that neural networks hand out harmful advice about diets. They suggest ways to hide the disorder and generate "inspiring weight loss content" that worsens the problem.

OpenAGI released the Lux model that overtakes Google and OpenAI

Startup OpenAGI released the Lux model for computer control and claims this is a breakthrough. According to benchmarks, the model overtakes analogues from Google, OpenAI and Anthropic by a whole generation. Moreover, it works faster. About 1 second per step instead of 3 seconds for competitors. And 10 times cheaper in cost per processing 1 token.