4ca24886a6
The explicit text_encoder_quant=nvfp4 path gated on the transformer smoke probe, which builds the dynamic-activation NVFP4 config, while the TE caster _cast_nvfp4 applies weight-only NVFP4WeightOnlyConfig. On a Blackwell build that carries the weight-only FP4 path but not the dynamic FP4 GEMM, the probe would fail and the encoder would silently stay dense even though the caster would run. Add a dedicated weight-only NVFP4 smoke probe (mirroring _cast_nvfp4's config) and route TE nvfp4 through it; int8 / fp8_dynamic keep the dynamic transformer probe since their TE casters are also dynamic-activation. |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| src-tauri | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_node_prebuilt.py | ||
| install_python_stack.py | ||
| install_sd_cpp_prebuilt.py | ||
| LICENSE.AGPL-3.0 | ||
| node_prebuilt_pins.json | ||
| package-lock.json | ||
| package.json | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||