LlamaCppBackend.load_model() only downloaded the first matching GGUF file. For split models (e.g. 7B Q8_0 with 3 shards), llama-server needs all shards present. Now collects and downloads all matching files. |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins/data-designer-unstructured-seed | ||
| requirements | ||
| routes | ||
| state | ||
| tests | ||
| utils | ||
| colab.py | ||
| main.py | ||
| run.py | ||