LlamaCppBackend.load_model() and precache_helper_gguf() only downloaded the first matching GGUF file. For split models (e.g. 7B Q8_0 with 3 shards), llama-server needs all shards present. Now collects and downloads all matching files. |
||
|---|---|---|
| .. | ||
| datasets | ||
| hardware | ||
| inference | ||
| models | ||
| paths | ||
| .gitkeep | ||
| cache_cleanup.py | ||
| transformers_version.py | ||
| utils.py | ||