FreeLLMNVIDIA Reshard collective speeds RL weight refit up to 5.7× on DGX H100 and DGX GB200
Reshard reduces communication payload for reinforcement‑learning refit, delivering 2.7‑5.7× faster updates on large models like Qwen 3 235B and DeepSeek v3 671B.
Current gather‑and‑broadcast refit methods duplicate the full model tensor, creating payloads of roughly twice the model size; for the largest open‑weight models the payload reaches about 10 TB per refit.
A hybrid approach applies Reshard to the dominant feed‑forward projection weights while keeping gather‑and‑broadcast for smaller weights, preserving functional coverage.
The open‑source NCCL M2N Reshard implementation is available via the NVIDIA/nccl‑extensions GitHub repository, with documentation on supported backends, layouts, and precision modes.
Ce que cela signifie pour vous
For developers running reinforcement‑learning pipelines, Reshard cuts the data moved between training and inference GPUs, lowering network traffic and reducing iteration time. Users of free or locally hosted models, such as the top‑ranked Kimi K3, can benefit from faster weight updates when scaling to large model sizes, making RL experimentation more practical on existing hardware.
Sources
- Accelerating Reinforcement Learning Weight Refit with the Reshard Collective, NVIDIA Developer (official), 6 Nov 2026
Rédigé automatiquement à partir des sources ci‑dessus, puis vérifié par notre code : chaque nombre et chaque nom doivent y figurer, et aucune phrase ne doit copier une source. Une erreur ? Signalez‑la.
Quelle IA pouvez‑vous utiliser gratuitement aujourd’hui ?
Tous les modèles IA gratuits, classés par votes humains anonymes, avec la mémoire et la vitesse dont ils ont besoin sur votre propre GPU.