LlamaCppBackend.load_model() and precache_helper_gguf() only downloaded the first matching GGUF file. For split models (e.g. 7B Q8_0 with 3 shards), llama-server needs all shards present. Now collects and downloads all matching files. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| chat_templates.py | ||
| data_collators.py | ||
| dataset_utils.py | ||
| format_conversion.py | ||
| format_detection.py | ||
| llm_assist.py | ||
| model_mappings.py | ||
| vlm_processing.py | ||