diff --git a/Home.md b/Home.md index 9cb5164..31b5e39 100644 --- a/Home.md +++ b/Home.md @@ -115,6 +115,15 @@ ALLOWED_QUANTS = \ } ``` +### Manually saving to GGUF +Firstly use the terminal and do: +```bash +git clone https://github.com/ggerganov/llama.cpp +cd llama.cpp && make clean && LLAMA_CUBLAS=1 make all -j +pip install gguf protobuf +``` +Then follow the steps at https://rentry.org/llama-cpp-conversions#merging-loras-into-a-model + ### Evaluation Loop - also OOM or crashing. Set the trainer settings for evaluation to: ```python