FreeLLMTencent unveils Wizard: real‑time agentic control for video game worlds
Wizard decouples animation, scene and logic to let players manipulate characters and environments at 24 FPS, generalising zero‑shot to new scenes.
The system uses structured visual proxies—skeletons and geometry—to control articulated characters and scene geometry, while adaptive masking preserves the appearance of reference assets.
Wizard was trained on 50.3 hours of aligned proxy‑video pairs covering 750 scenes and 178 characters, enabling interaction at 24 FPS and zero‑shot generalisation to unseen characters, motions and environments.
The framework maintains explicit world states, allowing adaptive boss behaviour and mechanics‑consistent combat, and supports actions such as character summoning, transformation and scene alteration.
Code for Wizard will be released soon, and the project page is https://wyzardwu.github.io/wizard/.
What it means for you
Wizard shows how structured proxies can give fine‑grained, real‑time control in video game generation, opening new possibilities for player‑driven content creation. For developers of free or locally‑run models, the approach suggests a path to richer interactive experiences without relying on massive visual datasets.
Sources
- Tencent paper: Wizard: Manipulate Any World in Real Time via Agentic Control, Hugging Face Papers (official), 28 Oct 2026
Written automatically from the sources above, then checked by our code: every number and name must appear in them, and no sentence may copy a source. Spotted a mistake? Report it.
Which AI can you use for free today?
Every free AI model, ranked by blind human votes, with the memory and speed it needs on your own GPU.