NVIDIA Dory 1.0 4B model can be run locally with llama.cpp, guide released
A November 2026 MarkTechPost guide shows how to compile and run NVIDIA's 4‑billion‑parameter Dory 1.0 BF16 model using llama.cpp.
NVIDIA made its Dory 1.0 4B language model available on Hugging Face under the repository nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16.
The tutorial walks users through building a pinned llama.cpp branch, analyzing compute costs per loop, testing memory caching, and executing paired evaluations.
The guide targets developers who want to run Dory locally, but it does not state a specific consumer machine that can hold the entire model in memory.
Dory joins other highly ranked free chat models such as Kimi K3 Max and GLM‑5.3 Max, expanding options for offline AI use.
あなたにとっての意味
For users seeking alternatives to paid offerings, Dory adds another high‑quality, open‑access model that can be experimented with on compatible hardware.
FreeLLMArena上
From our rankings on 7 Nov 2026, based on Arena's blind votes:
- NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16: on our model list
- Kimi K3 (Max): #1 among free chat models
ソース
- How to Run NVIDIA Dory 4B with llama.cpp: Loop by Loop Guide, MarkTechPost, 7 Nov 2026
- nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face, huggingface.co (official), 16 Oct 2026
上記のソースから自動的に生成し、当社のコードでチェックしました:すべての数値と名前が含まれ、文がソースをコピーしてはいけません。間違いを見つけましたか?報告する。
今日無料で使えるAIはどれですか?
すべての無料AIモデルをブラインドヒューマン投票で順位付けし、あなたのGPUで必要なメモリと速度を示します。