Skip to content

[PyTorch] Fix distributed BF16 weights and trim NVFP4 saved state in the fused grouped MLP - #3545

Open
xrennvidia wants to merge 8 commits into
NVIDIA:mainfrom
xrennvidia:xren/dist-weight-saved-tensor-hooks
Open

xrennvidia wants to merge 8 commits into
NVIDIA:mainfrom
xrennvidia:xren/dist-weight-saved-tensor-hooks

[PyTorch] Skip columnwise quantization of gathered distributed FC1 we…

274706e
Select commit
Loading
Failed to load commit list.