We’re rolling out an upgrade designed to help robots reason about the physical world. 🤖
Gemini Robotics-ER 1.6 has significantly better visual and spatial understanding in order to plan and complete more useful tasks. Here’s why this is important 🧵
VIDEO
Gemini Robotics-ER 1.6 enables robots to better pinpoint objects in an image.
Ask it to find tools in a cluttered workshop, and it can accurately identify and count the right items while ignoring things that aren't present.
Ask it to find tools in a cluttered workshop, and it can accurately identify and count the right items while ignoring things that aren't present.
VIDEO
The model knows when a task is complete to determine whether to retry it or move on - thanks to its multi-view reasoning and the ability to fuse live camera streams to understand a full scene.
Watch it process multiple angles to confirm if the job is done ↓
Watch it process multiple angles to confirm if the job is done ↓
VIDEO
A key strength: Gemini Robotics-ER 1.6 combines spatial reasoning, world knowledge, and agentic vision to allow robots to read a variety of instruments.
See how it reads an analogy gauge right down to sub tick accuracy ↓
See how it reads an analogy gauge right down to sub tick accuracy ↓
VIDEO
Industrial inspection is a massive visual challenge.
When robots like Spot from @BostonDynamics patrols a facility, it captures images of complex analog dials. Gemini Robotics-ER 1.6 is the upgrade that could process these, writing its own code to account for camera distortion and calculate exact tick marks.
When robots like Spot from @BostonDynamics patrols a facility, it captures images of complex analog dials. Gemini Robotics-ER 1.6 is the upgrade that could process these, writing its own code to account for camera distortion and calculate exact tick marks.
VIDEO
This is also our safest robotics model yet.
Gemini Robotics-ER 1.6 understands physical constraints like avoiding liquids or items over 20kg when carrying out instructions. It is also 10% better at detecting human injury risks in videos.
Gemini Robotics-ER 1.6 understands physical constraints like avoiding liquids or items over 20kg when carrying out instructions. It is also 10% better at detecting human injury risks in videos.
Ready to build smarter robots?
The model is available now on @GoogleAIStudio and the Gemini API. Find out more → goo.gle/4dGSh6y
The model is available now on @GoogleAIStudio and the Gemini API. Find out more → goo.gle/4dGSh6y
Generated by Thread Navigator
Press ⌘ + S to quick-export