5c249ebada
apply_step_cache on the video load path omitted quant_active, so a quantized video transformer (an engaged dense transformer_quant, or a GGUF checkpoint) that also enabled First-Block-Cache without an explicit threshold used the dense bf16 threshold (0.08) instead of the higher quantized threshold (0.12) the cache helper documents as needed for quantized transformers to trigger. The advertised quant plus FBCache path therefore cached far less than intended. Thread quant_active through exactly as the image path (diffusion.py) does: an engaged transformer_quant or a GGUF transformer both count as quant-active here. |
||
|---|---|---|
| .. | ||
| data_recipe | ||
| export | ||
| inference | ||
| rag | ||
| training | ||
| __init__.py | ||
| _torchao_stub.py | ||
| import_guards.py | ||
| tool_healing.py | ||