Updated Home (markdown)
parent
8e790b6603
commit
1f07fe501f
1 changed files with 9 additions and 0 deletions
9
Home.md
9
Home.md
|
|
@ -115,6 +115,15 @@ ALLOWED_QUANTS = \
|
|||
}
|
||||
```
|
||||
|
||||
### Manually saving to GGUF
|
||||
Firstly use the terminal and do:
|
||||
```bash
|
||||
git clone https://github.com/ggerganov/llama.cpp
|
||||
cd llama.cpp && make clean && LLAMA_CUBLAS=1 make all -j
|
||||
pip install gguf protobuf
|
||||
```
|
||||
Then follow the steps at https://rentry.org/llama-cpp-conversions#merging-loras-into-a-model
|
||||
|
||||
### Evaluation Loop - also OOM or crashing.
|
||||
Set the trainer settings for evaluation to:
|
||||
```python
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue