← Back to Blog

AI Industry

DeepMind's Genie 4 World Model Adds Native Audio

Oct 27, 2026·3 min read·By Rahish Saifi

A sunlit wildflower meadow with a small waterfall spilling over rocks into a clear stream, green hills and birds under a blue sky, with the headline GENIE 4 WORLD MODEL, the orange subline now with native audio, and an AIWithRahish badge in the bottom-right corner

On October 27, 2026, Google DeepMind introduced Genie 4, a new generation of world simulation built for real-time, interactive environments, according to a DeepMind blog post by Raia Hadsell, Diego Rivas, and Hang Qi. The model targets photorealistic visuals, fluid movement, and—critically—native audio: music, ambient noise, and interactive dialogue are generated together with the world. DeepMind describes Genie 4 as its first real-time world model to produce audio natively, not as a separate post-processing step.

What's new in Genie 4

Genie 4 is positioned as a step up in how synthetic worlds look, move, and sound. DeepMind highlights enhanced photorealism, smoother character motion, and audio that stays tied to what you see on screen. Physics realism is also a focus: the team points to better aerodynamics and collision behavior, plus more natural human movement. Characters can converse and react in real time inside the simulation, which matters for storytelling, training scenarios, and robotics demos where agents need believable human partners—not stiff mannequins.

The stack builds on Gemini. Gemini Omni anchors simulations in real-world appearance and behavior, while other Gemini models supply reasoning so scenes stay coherent as users steer them. That split—perception-heavy grounding plus reasoning for consistency—is how DeepMind frames the architecture behind a model that must update every frame under user control.

How Gemini steers the simulation

Users interact in real time with keyboard navigation and camera controls, plus natural-language text prompts: change the weather, reposition the camera, add a person or object. Gemini adapts those prompts to the current scene and monitors activity between inputs so the world does not drift blindly from one edit to the next.

Gemini 3.8 Flash acts as a guiding agent in the loop. It observes the scene, breaks high-level goals into steps, and reviews frames to verify each step before moving on. That agentic layer sits on top of raw world generation—useful when a single prompt like "walk to the door and open it" needs decomposition into motion, object interaction, and audio cues that match.

DeepMind is also experimenting with Gemini 4 Argon plus Genie 4 alongside Gemini Robotics. One demo simulates Apptronik's Apollo humanoid playing checkers—linking world simulation to embodied agents without claiming production robot deployment from the blog alone.

Who's testing it

Trusted testers across creative industries, journalism, education, gaming, and engineering are trying Genie 4 ahead of wider release. DeepMind cites several use patterns: filmmakers using a "draft mode" for pre-visualization, photojournalists turning a 2D archival photo into an explorable simulation, game developers prototyping mechanics, and enterprises generating scenario sandboxes for planning or training. Each case leans on the same core capability—steerable, real-time worlds—but with different fidelity and safety expectations.

Limits and safety

DeepMind is explicit about remaining research gaps. Details and object permanence can drift over longer sessions or after many edits. Complex physics, real-time audio accuracy, legible text, spatial accuracy, and long-term consistency are still active research areas—not solved product guarantees.

On safety, the company runs internal evaluations and is opening access to trusted testers first. All generated video and audio carry SynthID watermarks, aligning Genie output with Google's broader provenance tooling for synthetic media.

When you can use it

Genie 4 is in a research preview for trusted testers now. DeepMind says it is coming soon to Google AI Ultra subscribers in Project Genie, and to early-access partners through the Gemini API and Google AI Studio. A waitlist is available in Project Genie for those not yet in the tester cohort. The posts do not announce a single public launch date beyond "coming soon" for those channels.

Why it matters

DeepMind frames world simulation as crucial both for AGI research—agents that learn and plan in rich environments—and for training robots and other agents before they touch the real world. Native audio closes a gap that made many prior world models feel mute or disconnected; pairing that with Gemini steering and an in-loop guiding agent pushes simulation from passive video toward something you can direct like a live engine.

For developers and media teams, the near-term question is whether Project Genie and API access deliver enough consistency for production workflows, given the listed limitations on permanence and physics. For robotics, the Apollo checkers demo is a signal that Genie 4 may become a sandbox for Gemini Robotics—not a replacement for hardware validation, but a faster place to rehearse behavior. Watch trusted-tester feedback and Ultra rollout timing for the first read on whether Genie 4 is demo-grade or draft-grade for everyday work.

Sources