Google DeepMind just launched Genie 3 that can generate detailed, interactive 3D environments from a simple text prompt or image

Google DeepMind has just launched Genie 3, an advanced AI “world model” that can generate detailed, interactive 3D environments from a simple text prompt or image. Unlike its predecessor Genie 2, Genie 3 allows real-time exploration and modification of these worlds. Users can change objects, weather, or add characters dynamically—referred to as “promptable world events.” The environments maintain visual consistency over time, remembering the placement of objects for up to about a minute, and run at 720p resolution and 24 frames per second.

Genie 3 is positioned as a significant step toward artificial general intelligence (AGI) by providing complex, realistic interactive worlds that can train AI agents. This model does not rely on hard-coded physics but learns how the world works by remembering and reasoning about what it generates. It supports longer interactions than Genie 2—several minutes versus just 10-20 seconds—and enables AI agents and humans to move around and interact in these simulated worlds in real time.

Google DeepMind is currently releasing Genie 3 as a limited research preview to select academics and creators to study its risks and safety before wider access. It is not yet publicly available for general use. It is a breakthrough world model that creates immersive, interactive 3D environments useful both for gaming-type experiences and advancing AI research toward human-level intelligence.

Genie 3’s key technical differences that enable it to modify worlds dynamically on the fly include several innovations over previous models:

1. Frame-by-frame Real-time Generation at 24 FPS and 720p resolution: Genie 3 generates the environment live and continuously, allowing seamless, game-like interaction that feels immediate and natural.
2. Persistent World Memory: The model retains a “long-term visual memory” of the environment for several minutes, enabling the world to keep consistent state and the effects of user actions (e.g., painted walls stay painted even after moving away and returning) without re-generating from scratch.
3. Promptable World Events: Genie 3 supports dynamic insertion and alteration of elements in the generated world during real-time interaction via text prompts—for example, adding characters, changing weather, or introducing new objects on the fly. This is a major advancement over earlier systems that required pre-generated or less flexible environments.
4. More Sophisticated Physical and Ecological Modeling: The system models environments with realistic physical behaviors like water flow, lighting changes, and ecological dynamics, allowing more natural interactions and consistent environment evolution.
5. Real-time Response to User Actions: Unlike Genie 2, which processed user inputs with lag and limited real-time interaction, Genie 3 swiftly integrates user controls and environmental modifications frame by frame, resulting in highly responsive navigation and modification capabilities.
6. Underlying Architecture Improvements: While details are proprietary, Genie 3 leverages advances from over a decade of DeepMind’s research in simulated environments and world models, emphasizing multi-layered memory systems and inference mechanisms to maintain coherence and enable prompt-grounded modification of the simulation in real time.

Together, these technologies allow Genie 3 to generate, sustain, and modify richly detailed simulated worlds interactively, making it suitable for both immersive gaming experiences and as a robust platform for training advanced AI agents in complex, dynamic scenarios.