unsloth/studio/backend
Daniel Han 8ccb461570 studio: group GGUF shards by variant in size-based fallback
The smallest-fitting-variant fallback now groups split GGUF shards
by their variant prefix and sums all shard sizes per variant.

For example, DeepSeek-V3.2 UD-Q4_K_XL has 9 shards totaling
379.8 GB. The previous code treated each shard as a separate
"variant" and would have incorrectly selected a single 50 GB shard
as fitting, ignoring the other 8 shards needed.

Tested with unsloth/DeepSeek-V3.2-GGUF (237 GGUF files, 27
variants from 150 GB to 1.25 TB). Correctly groups and sorts
all variants by total size.
2026-03-15 05:24:06 -07:00
..
assets Final cleanup 2026-03-12 18:28:04 +00:00
auth fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
core studio: group GGUF shards by variant in size-based fallback 2026-03-15 05:24:06 -07:00
loggers Final cleanup 2026-03-12 18:28:04 +00:00
models studio: don't cap max_tokens for GGUF inference 2026-03-15 05:24:06 -07:00
plugins Final cleanup 2026-03-12 18:28:04 +00:00
requirements fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
routes studio: don't cap max_tokens for GGUF inference 2026-03-15 05:24:06 -07:00
state Final cleanup 2026-03-12 18:28:04 +00:00
tests fix(seed): disable remote code execution in seed inspect dataset loads (#4275) 2026-03-13 19:37:43 +04:00
utils studio: default to UD-Q4_K_XL for GGUFs, fall back to smallest 2026-03-15 05:24:06 -07:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
colab.py Final cleanup 2026-03-12 18:28:04 +00:00
main.py fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
run.py Final cleanup 2026-03-12 18:28:04 +00:00