Source: Media Outreach
The model combines three core capabilities — roaming, editing, and interaction — and is built on HiDream.ai’s self-developed UiT (Unified Transformer) architecture. The upgraded UiT delivers a key breakthrough on two persistent challenges in the field: spatiotemporal consistency and physical consistency. As cameras pan, zoom, or track, scene geometry remains stable — objects don’t vanish or deform, and collisions, occlusions, and gravitational responses follow real-world causal logic rather than appearing as randomly stitched frames.
“The value of an interactive world model isn’t in generating a photorealistic 3D scene — it’s in AI beginning to genuinely understand the depth of space, the texture of objects, the inertia of motion, and the logic of light and shadow,” said Yao Ting, CTO of HiDream.ai. “This is a systematic reconstruction of how the physical world works. HiDream-O1-World is the first bridge in that reconstruction — every interaction leads to a world never reached before.”
Topping the Leaderboard on Debut
HiDream-O1-World’s first third-party benchmark results came from WBench, an interactive world model evaluation benchmark jointly developed by Meituan’s LongCat team and Fudan University. The model topped the core Navi sub-leaderboard with an average score of 80.9, ranked first in the Physical dimension at 73.3, and scored 88.0 on Consistency — the best overall performance on the board.
WBench covers 289 multi-turn interaction cases and 1,058 interaction turns across five dimensions and 22 metrics. Its Navi board, focused on spatial navigation and viewpoint control, is widely regarded as the core measure of a world model’s spatial understanding. Topping Navi on its first entry, HiDream-O1-World sets a new performance ceiling for interactive world models — outperforming established players including Tencent Hunyuan 1.5.
One-Click World Generation for Immersive Interaction
The model lets users generate structurally complete, stylistically diverse interactive worlds from a short description, a single image, or simple controls. Upload a photo of a room, for example, and the model rapidly constructs a high-precision digital twin, completing the full panorama with accurate proportions and fine-grained detail.
Users can explore worlds in first-person or third-person mode, freely driving a character and adjusting viewpoints. In a diving scene, light patterns on the water surface and refracted glimmers on the seabed shift in sync with the camera; coral textures remain crisp and drift-free throughout.
Beyond roaming, HiDream-O1-World enables real-time editing — directing characters to grab, run, crouch, or jump, or triggering environmental events like rainfall. Changes maintain globally unified coherence across geometry, lighting, materials, and physical logic, ensuring every interaction remains self-consistent.
The model generalizes across humans, animals, and fictional characters, adapting to each one’s form and motion. In a snow-climbing scene, footprints press realistic indentations into the snow, snowflakes drift at varied speeds, and distant ridgelines blend naturally with rock textures as the viewpoint shifts. It supports a wide scene and stylistic range — from real city streets and natural terrain to anime-style cartoons and AAA-game-grade rendering.
Two Core Breakthroughs: Spatiotemporal and Physical Consistency
Interactive world models have long been constrained by three problems: space, physics, and memory. Camera switches cause blurring and scene drift; physics violations undermine credibility; and without long-term memory, objects disappear when the view turns. HiDream-O1-World addresses these through two coordinated capabilities:
Long-horizon spatiotemporal consistency. The model pairs 3D priors injected into Memory context with Test-Time Training (TTT) online maintenance. The Memory mechanism encodes scene geometry and object relationships as 3D priors, letting the model “remember” explored structures across viewpoint switches — fundamentally eliminating drift and scene resets. TTT performs lightweight online adaptation during inference, dynamically optimizing adapters so internal representations stay aligned with the scene’s 3D constraints. Where conventional models act like a painter redrawing every frame — with errors compounding into drift and vanishing objects — HiDream-O1-World behaves like a director with spatial memory: it records scene structure rather than re-guessing the environment at each step, recalling the corresponding view when the camera moves.
Globally stable physical consistency. On the training side, a generative world simulator produces synthetic data covering rigid-body collisions, fluid motion, soft-body deformation, and gravity-driven projectiles — systematically reinforcing the model’s inductive bias through physics-simulated data. On the inference side, the same TTT mechanism enhances physical consistency online, adjusting representations when new object types or materials appear so subsequent frames better follow that scene’s physics. This dual-engine design delivers gains of 13.6% over the industry average on visual-plausibility evaluation and 12.7% on causal-fidelity evaluation across fluid, collision, and deformation dimensions.
The research has been accepted to ECCV 2026 (European Conference on Computer Vision), one of the three premier academic conferences in computer vision and AI.
Paper: DreamWorld: Geometry-Grounded Video Diffusion for 3D-Consistent World Modeling
Project page: https://yanghb22-fdu.github.io/DreamWorld
Three New Industry Frontiers
Beyond technical breakthroughs, HiDream-O1-World opens new possibilities for industrial transformation:
AI interactive film and games. Users no longer follow a linear plot passively but become active participants, with worlds evolving along branching storylines — delivering cinematic visual quality, unprecedented immersion, and the enjoyment of multiple endings.
Embodied-AI simulation. The model builds physically grounded, high-fidelity simulation spaces — cities, factories, interiors — providing virtual testbeds for robotics training, autonomous driving, and smart manufacturing, replacing high-cost, high-risk real-world testing.
3D scene production. Creators can generate 3D figurines, home scenes, and art spaces with complete structure and rich detail, supporting structural fine-tuning and instant style switching. It even extends to the microscopic world — simulating cellular behavior and protein interactions for drug discovery and disease-mechanism research.
When the physical world can be generated at a click and explored freely, many industries deserve to be reimagined. These fields are only the tip of the iceberg — as more developers and creators join, the application boundaries of interactive world models will extend far beyond what can be described today.
Hashtag: #HiDreamAI
The issuer is solely responsible for the content of this announcement.
– Published and distributed with permission of Media-Outreach.com.