ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/studio/backend/core/inference
History
Roland Tannous defa761fb2 fix: download all GGUF shards for split models (e.g. 7B Q8_0) 
LlamaCppBackend.load_model() only downloaded the first matching GGUF
file. For split models (e.g. 7B Q8_0 with 3 shards), llama-server
needs all shards present. Now collects and downloads all matching files.
2026-03-10 19:04:10 +00:00
..
__init__.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
audio_codecs.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
inference.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
llama_cpp.py fix: download all GGUF shards for split models (e.g. 7B Q8_0) 2026-03-10 19:04:10 +00:00
orchestrator.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
worker.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00