FreeLLMAll models › RecursiveSI
Where to use it for free
- Free API on OpenRouter: model id
recursive/flint-v1.0:free. Try it side by side · OpenRouter page - Download and run it at home: official weights · GGUF files for Ollama and LM Studio
New: waiting for Arena votes
Released on 21 Oct 2026. Arena has not voted on this model yet. As soon as it does, the model moves into the ranking automatically, usually the next night. Until then you can still check its size, memory needs and speed below, and try it for free.
Speed on popular hardware
| Hardware | GPU memory | Fits? | Speed |
|---|---|---|---|
| RTX 3060 12 GB | 12 GB | GPU + 64 GB RAM | 50 tok/s |
| RTX 4060 Ti 16 GB | 16 GB | GPU + 64 GB RAM | 52 tok/s |
| RTX 3090 | 24 GB | GPU + 64 GB RAM | 134 tok/s |
| RTX 4090 | 24 GB | GPU + 64 GB RAM | 139 tok/s |
| RTX 5090 | 32 GB | Fits in GPU | 218 tok/s |
| RX 7900 XTX | 24 GB | GPU + 64 GB RAM | 136 tok/s |
| 2 × RTX 3090 | 48 GB | Fits in GPU | 156 tok/s |
| 4 × RTX 3090 | 96 GB | Fits in GPU | 148 tok/s |
| Mac M4 Max 128 GB | 96 GB | Fits in GPU | 81 tok/s |
| Ryzen AI Max+ 395 128 GB | 96 GB | Fits in GPU | 65 tok/s |
| 8 × H100 SXM | 640 GB | Fits in GPU | 220 tok/s |
Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 78% ÷ data read per token, plus a fixed cost per token, calibrated on 44 real llama.cpp tests; typical error about ±10%. Compare all GPUs.
GPU memory needed
| Level | 8K context | 32K context | 128K context | Quality vs full |
|---|---|---|---|---|
| Q3_K_M | 21 GB | 21 GB | 24 GB | +6.2% noticeable loss |
| Q4_K_M | 25 GB | 26 GB | 29 GB | +1.6% small loss |
| Q5_K_M | 29 GB | 30 GB | 33 GB | +0.5% near-lossless |
| Q6_K | 34 GB | 34 GB | 37 GB | +0.2% near-lossless |
| Q8_0 | 43 GB | 44 GB | 47 GB | ≈ 0% same as full |
| F16 | 80 GB | 81 GB | 84 GB | ≈ 0% same as full |
Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.
Share this page:XLinkedInRedditWhatsApp
Spotted a wrong number or a broken link? Report a mistake