ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/studio/backend/core/inference
History
Roland Tannous c2dd0f4cf1 fix: download all GGUF shards for split models (e.g. 7B Q8_0) 
LlamaCppBackend.load_model() and precache_helper_gguf() only downloaded
the first matching GGUF file. For split models (e.g. 7B Q8_0 with 3
shards), llama-server needs all shards present. Now collects and
downloads all matching files.
2026-03-10 15:08:20 +00:00
..
__init__.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
audio_codecs.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
inference.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
llama_cpp.py fix: download all GGUF shards for split models (e.g. 7B Q8_0) 2026-03-10 15:08:20 +00:00
orchestrator.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
worker.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00