Updated Home (markdown)
parent
464a58501a
commit
fc25b4e525
1 changed files with 11 additions and 8 deletions
19
Home.md
19
Home.md
|
|
@ -55,16 +55,19 @@ model.save_pretrained_merged("model", tokenizer, save_method = "lora",)
|
|||
model.push_to_hub_merged("hf/model", tokenizer, save_method = "lora", token = "")
|
||||
```
|
||||
|
||||
### Evaluation Loop OOM or crashing.
|
||||
### Evaluation Loop - also OOM or crashing.
|
||||
Set the trainer settings for evaluation to:
|
||||
```python
|
||||
TrainingArguments(
|
||||
fp16_full_eval = True,
|
||||
per_device_eval_batch_size = 2,
|
||||
eval_accumulation_steps = 4,
|
||||
evaluation_strategy = "steps",
|
||||
eval_steps = 1,
|
||||
)
|
||||
SFTTrainer(
|
||||
args = TrainingArguments(
|
||||
fp16_full_eval = True,
|
||||
per_device_eval_batch_size = 2,
|
||||
eval_accumulation_steps = 4,
|
||||
evaluation_strategy = "steps",
|
||||
eval_steps = 1,
|
||||
),
|
||||
train_dataset = train_dataset,
|
||||
eval_dataset = eval_dataset,
|
||||
```
|
||||
This will cause no OOMs and make it somewhat faster with no upcasting to float32.
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue