Updated Home (markdown)

Daniel Han 2024-03-31 12:51:50 +11:00
commit 1f07fe501f

@ -115,6 +115,15 @@ ALLOWED_QUANTS = \
}
```
### Manually saving to GGUF
Firstly use the terminal and do:
```bash
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp && make clean && LLAMA_CUBLAS=1 make all -j
pip install gguf protobuf
```
Then follow the steps at https://rentry.org/llama-cpp-conversions#merging-loras-into-a-model
### Evaluation Loop - also OOM or crashing.
Set the trainer settings for evaluation to:
```python