ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/async_task_outputs/async_task_output_i52q64.md
Daniel Han c800e89206 Merge remote-tracking branch 'origin/image-generation' into diffusion-image-workflows 
# Conflicts:
#	studio/backend/core/inference/diffusion.py
#	studio/frontend/src/features/images/images-page.tsx
2026-07-02 03:36:50 +00:00

620 B
Raw Blame History

Continue from the latest user question: answer whether NXFP4/NVFP4 is supported through PyTorch core and TorchAO, based on the completed probe and PR updates. The in-flight work is complete: NVFP4 probe was measured, committed, pushed, PR body updated, and PR #6694 verified OPEN/MERGEABLE with sync 0/0. Next action is to provide the final concise answer: PyTorch core has FP4 primitives but no turnkey quantization flow; TorchAO supports NVFP4, but in this environment torch 2.9 only works with use_triton_kernel=False as a slow bf16-rate path, while the fast path needs MSLK or torch >= 2.11 CUTLASS FP4 extensions.