FreeLLMNVIDIA releases Agent Substrate, a CNCF sandbox for high‑density AI agent workloads
NVIDIA announced Agent Substrate, an open‑source runtime for sandboxed AI agents that runs as a CNCF Sandbox project.
NVIDIA announced Agent Substrate, an open‑source runtime for sandboxed AI agents that runs as a CNCF Sandbox project.
The system pairs with NVIDIA Dynamo and the KAI Scheduler inside the DSX AI Factory Platform to coordinate inference, agent environments, and shared cluster resources.
Agent Substrate keeps a small pool of ready worker Pods and checkpoints idle agents, including full memory and filesystem state, to restore them on any free worker.
The design adds request parking, per‑container limits for microVM sandboxes, and a vendor‑neutral approach to pausing and restoring GPU state via Kubernetes Dynamic Resource Allocation.
What it means for you
For AI platform operators, Agent Substrate promises up to ten‑fold higher agent density and eliminates costly cold‑starts, improving responsiveness for coding assistants and RL training. Users of free or locally hosted models benefit from a more efficient runtime that can host many agents on shared hardware, reducing the need for dedicated resources per session.
Sources
- Agent Substrate: Advancing Kubernetes for Agents at Scale, NVIDIA Developer (official), 10 Nov 2026
Written automatically from the sources above, then checked by our code: every number and name must appear in them, and no sentence may copy a source. Spotted a mistake? Report it.
Which AI can you use for free today?
Every free AI model, ranked by blind human votes, with the memory and speed it needs on your own GPU.