FreeLLMNVIDIA Dory 1.0 4B model can be run locally with llama.cpp, guide released
A November 2026 MarkTechPost guide shows how to compile and run NVIDIA's 4‑billion‑parameter Dory 1.0 BF16 model using llama.cpp.
NVIDIA made its Dory 1.0 4B language model available on Hugging Face under the repository nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16.
The tutorial walks users through building a pinned llama.cpp branch, analyzing compute costs per loop, testing memory caching, and executing paired evaluations.
The guide targets developers who want to run Dory locally, but it does not state a specific consumer machine that can hold the entire model in memory.
Dory joins other highly ranked free chat models such as Kimi K3 Max and GLM‑5.3 Max, expanding options for offline AI use.
Ce que cela signifie pour vous
For users seeking alternatives to paid offerings, Dory adds another high‑quality, open‑access model that can be experimented with on compatible hardware.
Sur FreeLLMArena
From our rankings on 7 Nov 2026, based on Arena's blind votes:
- NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16: on our model list
- Kimi K3 (Max): #1 among free chat models
Sources
- How to Run NVIDIA Dory 4B with llama.cpp: Loop by Loop Guide, MarkTechPost, 7 Nov 2026
- nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face, huggingface.co (official), 16 Oct 2026
Rédigé automatiquement à partir des sources ci‑dessus, puis vérifié par notre code : chaque nombre et chaque nom doivent y figurer, et aucune phrase ne doit copier une source. Une erreur ? Signalez‑la.
Quelle IA pouvez‑vous utiliser gratuitement aujourd’hui ?
Tous les modèles IA gratuits, classés par votes humains anonymes, avec la mémoire et la vitesse dont ils ont besoin sur votre propre GPU.