Get Started#
Welcome to FlashDreams! This page will guide you from a fresh checkout of the repository to a running model. It uses NVIDIA OmniDreams, the interactive driving world model, as the example; the model gallery lists the run command for every other model.
Install#
FlashDreams uses the uv Python package manager (installation
instructions).
With uv installed, clone the repository and synchronize the
OmniDreams workspace:
git clone https://github.com/NVIDIA/flashdreams.git
cd flashdreams
uv sync --package flashdreams-omnidreams --extra interactive-drive
Most runs need a Hugging Face token. For OmniDreams, use a token with read access to nvidia/omni-dreams-models and nvidia/omni-dreams-scenes:
export HF_TOKEN=<your-hf-token>
For container, caching, and other environment details, see the project README and Troubleshooting.
Run your first model#
Launch the OmniDreams interactive driving demo. It runs the world model and streams the generated camera view to a browser over WebRTC:
uv run --package flashdreams-omnidreams flashdreams-run-v2 \
interactive-drive-omnidreams --mode webrtc \
--host 0.0.0.0 --port 8089
Then open http://<server-ip>:8089/request_session in a browser on the same network
(use localhost on the same machine). The first launch spends several
minutes loading checkpoints and compiling kernels; later launches reuse
the cached assets.
Inspect the application arguments without loading checkpoints:
uv run --package flashdreams-omnidreams flashdreams-run-v2 \
interactive-drive-omnidreams -- --help
See NVIDIA OmniDreams for scripted generation, scene variants, native-window serving, and multi-GPU options.
Where to next#
Models: every shipped model with its CLI slug and the command to run it.
NVIDIA OmniDreams: drive a world model in real time with the
local-windoworwebrtclaunch mode.Inference pipeline overview: the generation loop end to end: KV cache, ring attention, CUDA-graph capture.
Config system: the configuration layer every method shares.
Add a new method: adding a new model or method as a plugin.
CLI and API Reference: Reference docs for the
flashdreams-runCLI and the FlashDreams Python API.Troubleshooting: common first-run failures and fixes.