FreeLLMNVIDIA Blackwell GPUs cut FLUX 3 Image Klein latency up to 3.46× on single B200
TensorRT LLM VisualGen optimizations deliver up to 3.46× faster text‑to‑image and 4.45× faster image‑to‑image generation on a Blackwell B200 GPU.
NVIDIA’s TensorRT LLM VisualGen runtime was used to accelerate FLUX 3 Image Klein, a diffusion model from Black Forest Labs, on Blackwell GPUs.
On a single B200 GPU, NVFP4 precision already gave 1.62× faster text‑to‑image (T2I) and 1.58× faster image‑to‑image (I2I) compared with BF16.
Further optimizations—fused GEMM kernels, FP8 attention, cache‑DiT step caching and sparse Sol‑Attention—boosted performance to 3.46× faster T2I and 4.45× faster I2I at 2048×2048 resolution.
Multi‑GPU scaling with eight B200 cards reduced median T2I latency from 14.90 s to 3.00 s and I2I from 2.73 s to 1.08 s, achieving 6.01× and 4.44× denoising speedups respectively.
The optimized pipeline keeps most of the generation time in denoising, which dropped from 96.8% to around half when caching was applied.
あなたにとっての意味
Developers can now integrate FLUX 3 Image Klein into design tools with markedly lower latency, enabling real‑time image editing workflows. The gains also show that high‑resolution diffusion models can run efficiently on a single Blackwell GPU, reducing reliance on large GPU clusters for many users.
ソース
- Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs, NVIDIA Developer (official), 6 Nov 2026
上記のソースから自動的に生成し、当社のコードでチェックしました：すべての数値と名前が含まれ、文がソースをコピーしてはいけません。間違いを見つけましたか？報告する。
今日無料で使えるAIはどれですか？
すべての無料AIモデルをブラインドヒューマン投票で順位付けし、あなたのGPUで必要なメモリと速度を示します。