Post Thumbnail

Gemini Robotics: new approach to AI robot control

Google introduced the Gemini Robotics system, bringing AI agents into the physical world. The company developed an advanced agent system for robot control. Capable of better reasoning and planning, interacting with humans and using tools like web search.

Inside the system, 2 models work simultaneously. Gemini Robotics-ER 1.5 and Gemini Robotics 1.5 perform different functions in robot control. The first model serves as high-level brain, analyzes environment and human actions or commands, creates detailed task execution plan and calls tools when necessary.

Gemini Robotics 1.5 acts as executor, transforming instructions into precise motor commands for robot. For example, when requested to correctly sort trash based on user location, the system works step by step.

Gemini Robotics-ER 1.5 analyzes request, accesses internet to understand trash sorting rules in specific country. Evaluates available trash and gives commands like bottle in left pile, napkin in right. The model outputs trace of its reasoning, making system more interpretable.

Gemini Robotics 1.5 receives commands from ER and transforms them into precise movement trajectories. If something in environment changes during process, ER notices this and corrects instructions. When robot shape changes, entire system doesn’t need adaptation, adjusting second model is enough.

Gemini Robotics 1.5 is a vision-language-action model, transforming visual information and instructions into robot commands, thinking before acting and explaining its process. Gemini Robotics-ER 1.5 is responsible for planning and logical decisions, can call digital tools and create step-by-step plans.

The models allow robots to execute complex multi-step tasks, learn from different device types and act more transparently and safely.

Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
UBTech will send Walker S2 robots to serve on China's border for $37 million

Chinese company UBTech won a contract for $37 million. And will send humanoid robots Walker S2 to serve on China's border with Vietnam. South China Morning Post reports that the robots will interact with tourists and staff, perform logistics operations, inspect cargo and patrol the area. And characteristically — they can independently change their battery.

Anthropic accidentally revealed an internal document about Claude's "soul"

Anthropic accidentally revealed the "soul" of artificial intelligence to a user. And this is not a metaphor. This is a quite specific internal document.

Jensen Huang ordered Nvidia employees to use AI everywhere

Jensen Huang announced total mobilization under the banner of artificial intelligence inside Nvidia. And this is no longer a recommendation. This is a requirement.

AI chatbots generate content that exacerbates eating disorders

A joint study by Stanford University and the Center for Democracy and Technology showed a disturbing picture. Chatbots with artificial intelligence pose a serious risk to people with eating disorders. Scientists warn that neural networks hand out harmful advice about diets. They suggest ways to hide the disorder and generate "inspiring weight loss content" that worsens the problem.

OpenAGI released the Lux model that overtakes Google and OpenAI

Startup OpenAGI released the Lux model for computer control and claims this is a breakthrough. According to benchmarks, the model overtakes analogues from Google, OpenAI and Anthropic by a whole generation. Moreover, it works faster. About 1 second per step instead of 3 seconds for competitors. And 10 times cheaper in cost per processing 1 token.