ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/studio/backend/utils
History
Daniel Han ab6fdccfb5 studio: reorder GGUF preference -- UD-Q4_K_XL first, all UD above standard 
Reorder _GGUF_QUANT_PREFERENCE so all UD (Unsloth Dynamic) variants
come before standard quants. UD-Q4_K_XL is the default (best
size/quality tradeoff), followed by other UD quants in decreasing
preference order.

For repos without UD variants (e.g., bartowski), falls through to
standard quants starting with Q4_K_M.

Verified with:
  - unsloth/Qwen3.5-35B-A3B-GGUF -> UD-Q4_K_XL
  - bartowski/Qwen_Qwen3.5-35B-A3B-GGUF -> Q4_K_M
  - unsloth/DeepSeek-V3.2-GGUF -> UD-Q4_K_XL (9 shards)
  - unsloth/Llama-3.2-1B-Instruct-GGUF -> UD-Q4_K_XL
2026-03-15 05:24:06 -07:00
..
datasets fix: prevent ai-assist model config RCE via untrusted Hugging Face repos (#4274) 2026-03-13 19:29:11 +04:00
hardware Final cleanup 2026-03-12 18:28:04 +00:00
inference Final cleanup 2026-03-12 18:28:04 +00:00
models studio: reorder GGUF preference -- UD-Q4_K_XL first, all UD above standard 2026-03-15 05:24:06 -07:00
paths [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-03-15 05:24:06 -07:00
.gitkeep root studio folder 2026-02-02 09:13:49 +00:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
cache_cleanup.py Final cleanup 2026-03-12 18:28:04 +00:00
transformers_version.py Final cleanup 2026-03-12 18:28:04 +00:00
utils.py Final cleanup 2026-03-12 18:28:04 +00:00