Gemini Robotics On-Device is a new AI model from Google DeepMind designed to run directly on robots without needing an internet connection. It is a compact, efficient version of the earlier Gemini Robotics model, optimized to perform complex tasks locally on a robot’s built-in hardware, enabling low-latency, reliable operation even in environments with weak or no connectivity.
Key features include:
- Ability to perform detailed physical tasks such as folding clothes, unzipping bags, and assembling parts, with high precision146.
- Runs entirely on-device, processing all data locally, which enhances privacy and security—important for sensitive fields like healthcare and industrial automation17.
- Can adapt to new tasks quickly after as few as 50 to 100 demonstrations, showing flexibility and responsiveness in unfamiliar situations148.
- Originally trained on Google’s ALOHA robot but successfully adapted to other robots including the bi-arm Franka FR3 and the humanoid Apollo by Apptronik348.
- While it lacks built-in semantic safety tools present in the cloud-based Gemini Robotics model, developers are encouraged to implement their own safety controls1.
Google has also released a software development kit (SDK) to allow developers to test and fine-tune the model on various robotic platforms34.
Gemini Robotics On-Device enables advanced, privacy-conscious, and reliable robotic AI functionality locally on devices, marking a significant step for robotics in offline or connectivity-limited environments1368.