Google Research· Research

Vibe Coding XR: Accelerating AI + XR prototyping with XR Blocks and Gemini

Ruofei Du, Interactive Perception & Graphics Lead, and Benjamin Hersh, Product Manager, Google XR Vibe Coding XR is a rapid prototyping workflow that empowers Gemini Canvas with the open-source XR Blocks framework to translate user prompts into fully interactive, physics-aware WebXR applications for Android XR, allowing creators to quickly test intelligent spatial experiences in both simulated environments on desktop and on Android XR headsets. Quick links Live demo Technical report XR Blocks on GitHub XR Blocks demos Video demo Share Copy link × Large language models (LLMs) and agentic workflows are changing software engineering and creative computing. We are seeing a shift toward “ vibe coding ”, where LLMs turn human intent directly into working code. Tools like Gemini Canvas already make this possible for 2D and 3D web development. However, extended reality (XR) remains difficult to access. Prototyping in XR typically requires piecing together fragmented perception pipelines, complex game engines, and low-level sensor integrations. …

Announced

25 Mar 2026 09:14 UTC