Updated Home (markdown)

Daniel Han 2024-09-08 14:40:26 -07:00
commit 9618d879e8

@ -168,7 +168,7 @@ make clean -C llama.cpp
make all -j -C llama.cpp
pip install gguf protobuf
python llama.cpp/convert-hf-to-gguf.py FOLDER --outfile OUTPUT --outtype f16
python llama.cpp/convert_hf_to_gguf.py FOLDER --outfile OUTPUT --outtype f16
```
Or follow the steps at https://rentry.org/llama-cpp-conversions#merging-loras-into-a-model using the model name "merged_model" to merge to GGUF.