FreeLLMNVIDIA Reshard collective speeds RL weight refit up to 5.7× on DGX H100 and DGX GB200
Reshard reduces communication payload for reinforcement‑learning refit, delivering 2.7‑5.7× faster updates on large models like Qwen 3 235B and DeepSeek v3 671B.
Current gather‑and‑broadcast refit methods duplicate the full model tensor, creating payloads of roughly twice the model size; for the largest open‑weight models the payload reaches about 10 TB per refit.
A hybrid approach applies Reshard to the dominant feed‑forward projection weights while keeping gather‑and‑broadcast for smaller weights, preserving functional coverage.
The open‑source NCCL M2N Reshard implementation is available via the NVIDIA/nccl‑extensions GitHub repository, with documentation on supported backends, layouts, and precision modes.
O que isso significa para você
For developers running reinforcement‑learning pipelines, Reshard cuts the data moved between training and inference GPUs, lowering network traffic and reducing iteration time. Users of free or locally hosted models, such as the top‑ranked Kimi K3, can benefit from faster weight updates when scaling to large model sizes, making RL experimentation more practical on existing hardware.
Fontes
- Accelerating Reinforcement Learning Weight Refit with the Reshard Collective, NVIDIA Developer (official), 6 Nov 2026
Escrito automaticamente a partir das fontes acima, depois verificado pelo nosso código: todo número e nome deve aparecer nelas, e nenhuma frase pode copiar uma fonte. Encontrou um erro? Reporte‑o.
Qual IA você pode usar grátis hoje?
Todo modelo de IA gratuito, classificado por votos humanos cegos, com a memória e velocidade que ele precisa na sua própria GPU.