Daniel Han-Chen
e8b3cf01b1
Update README.md
2024-06-14 20:53:51 +10:00
Daniel Han-Chen
cdb1dbb5ff
Update llama.py
2024-06-14 20:42:19 +10:00
Daniel Han-Chen
d8d332ac83
Update llama.py
2024-06-14 20:37:10 +10:00
Daniel Han-Chen
fe8c06496f
Update llama.py
2024-06-14 20:32:01 +10:00
Daniel Han-Chen
b56b8b84dc
Update qwen2.py
2024-06-14 20:24:06 +10:00
Daniel Han-Chen
358103718f
Update qwen2.py
2024-06-14 20:19:37 +10:00
Daniel Han-Chen
1b93d7eee6
Update qwen2.py
2024-06-14 20:16:58 +10:00
Daniel Han-Chen
2401dee8ff
Update mistral.py
2024-06-14 20:15:47 +10:00
Walter Korman
6c031e4a32
README: Fix minor typo. ( #559 )
...
* README: Fix minor typo.
One-character typo fix while reading.
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-06-14 18:11:28 +10:00
Daniel Han-Chen
b6f0fdb53d
Update qwen2.py
2024-06-14 18:07:42 +10:00
Daniel Han-Chen
d98e45e41b
Update README.md
2024-06-14 18:06:12 +10:00
Daniel Han-Chen
b82277f710
docs
2024-06-14 18:05:39 +10:00
Daniel Han-Chen
9c6d4155de
Merge branch 'main' into nightly
2024-06-14 17:45:56 +10:00
Daniel Han-Chen
7ac1a78904
Update __init__.py
2024-06-14 16:00:26 +10:00
Daniel Han-Chen
b74e321f92
Update qwen2.py
2024-06-14 04:44:52 +10:00
Daniel Han-Chen
411b881dba
Merge branch 'main' into nightly
2024-06-14 03:25:55 +10:00
Daniel Han-Chen
52ab81372d
Update tokenizer_utils.py
2024-06-14 03:24:28 +10:00
Daniel Han
d2c0c1bbda
Nightly ( #632 )
...
* Update llama.py
* offload
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* continued pretraining trainer
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* is_bfloat16_supported
* Update __init__.py
* Update README.md
* Update llama.py
* is_bfloat16_supported
* Update __init__.py
* Mistral v3
* Phi 3 medium
* Update chat_templates.py
* Update chat_templates.py
* Phi-3
* Update save.py
* Update README.md
Mistral v3 to Mistral v0.3
* Untrained tokens
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update llama.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update save.py
* Update save.py
* Update save.py
* checkpoint
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update llama.py
* accelerate
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update tokenizer_utils.py
* train_dataloader
* Update llama.py
* Update llama.py
* Update llama.py
* use_fast_convert
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* remove_special_tokens
* Ollama
* Update chat_templates.py
* Update chat_templates.py
* Update chat_templates.py
* Update llama.py
* Update chat_templates.py
* Support bfloat16 GGUF
* Update save.py
* Update llama.py
* fast_forward_inference
* Update mapper.py
* Update loader.py
* Update llama.py
* Update tokenizer_utils.py
* info
* edits
* Create chat template
* Fix tokenizer
* Update tokenizer_utils.py
* fix case where gguf saving fails due to first_conversion dtype (#630 )
* Support revision parameter in FastLanguageModel.from_pretrained (#629 )
* support `revision` parameter
* match unsloth formatting of named parameters
* clears any selected_adapters before calling internal_model.save_pretrained (#609 )
* Update __init__.py (#602 )
Check for incompatible modules before importing unsloth
* Fixed unsloth/tokenizer_utils.py for chat training (#604 )
* Add GGML saving option to Unsloth for easier Ollama model creation and testing. (#345 )
* Add save to llama.cpp GGML to save.py.
* Fix conversion command and path of convert to GGML function.
* Add autosaving lora to the GGML function
* Create lora save function for conversion to GGML
* Test fix #2 for saving lora
* Test fix #3 to save the lora adapters to convert to GGML
* Remove unwated tokenizer saving for conversion to ggml and added a few print statements.
* Needed tokenizer for saving, added it back, also made it more unslothy style by having positional arguments, and added a few messages.
* Positional arguments didn't work out, so reverted to older version of the code, and added a few comments.
* Test fix 1 for arch
* Test fix 2 new Mistral error.
* Test fix 3
* Revert to old version for testing.
* Upload issue test fix 1
* Fix 2 uploading ggml
* Positional ags added.
* Temporray remove positional args
* Fix upload again!!!
* Add print statements and fix link
* Make the calling name better
* Create local saving for GGML
* Add choosing directory to save local GGML.
* Fix lil variable error in the save_to_custom_dir func
* docs: Add LoraConfig parameters documentation (#619 )
* llama.cpp failing (#371 )
llama.cpp is failing to generate quantize versions for the trained models.
Error:
```bash
You might have to compile llama.cpp yourself, then run this again.
You do not need to close this Python program. Run the following commands in a new terminal:
You must run this in the same folder as you're saving your model.
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp && make clean && LLAMA_CUDA=1 make all -j
Once that's done, redo the quantization.
```
But when i do clone this with recursive it works.
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix libcuda_dirs import for triton 3.0 (#227 )
* fix libcuda_dirs import for triton 3.0
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update save.py
* Update __init__.py
* Update fast_lora.py
* Update save.py
* Update save.py
* Update save.py
* Update loader.py
* Update save.py
* Update save.py
* quantize now llama-quantize
* Update chat_templates.py
* Update loader.py
* Update mapper.py
* Update __init__.py
* embedding size
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Eliot Hall <60240707+chrehall68@users.noreply.github.com>
Co-authored-by: Rickard Edén <rickardeden@gmail.com>
Co-authored-by: XiaoYang <xyangk@gmail.com>
Co-authored-by: Oseltamivir <58582368+Oseltamivir@users.noreply.github.com>
Co-authored-by: mahiatlinux <110882203+mahiatlinux@users.noreply.github.com>
Co-authored-by: Sébastien De Greef <sebdg@binarycompany.com>
Co-authored-by: Alberto Ferrer <albertof@barrahome.org>
Co-authored-by: Thomas Viehmann <tv.github-private@beamnet.de>
2024-06-14 02:58:08 +10:00
Daniel Han-Chen
71edc42ed3
embedding size
2024-06-14 02:39:07 +10:00
Daniel Han-Chen
0a304aefc0
Update __init__.py
2024-06-14 00:07:42 +10:00
Daniel Han-Chen
eb906d04bf
Update mapper.py
2024-06-14 00:00:59 +10:00
Daniel Han-Chen
08424f04c9
Update loader.py
2024-06-13 23:58:48 +10:00
Daniel Han-Chen
82f10cbaac
Update chat_templates.py
2024-06-13 22:50:38 +10:00
Daniel Han-Chen
7d847ed318
quantize now llama-quantize
2024-06-13 22:50:08 +10:00
Daniel Han-Chen
4822eaeffa
Update save.py
2024-06-13 22:30:50 +10:00
Daniel Han-Chen
e35f608233
Update save.py
2024-06-13 20:12:50 +10:00
Daniel Han-Chen
48c6d6dbee
Update loader.py
2024-06-13 19:47:17 +10:00
Daniel Han-Chen
b24dd050bf
Update save.py
2024-06-13 19:44:51 +10:00
Daniel Han-Chen
0abb5ba23e
Update save.py
2024-06-13 19:39:04 +10:00
Daniel Han-Chen
4a8ba90605
Update save.py
2024-06-13 19:28:48 +10:00
Daniel Han-Chen
6a516573d0
Update fast_lora.py
2024-06-13 19:26:33 +10:00
Daniel Han-Chen
26dc50294a
Update __init__.py
2024-06-13 19:25:27 +10:00
Daniel Han-Chen
1601dca031
Update save.py
2024-06-13 19:23:31 +10:00
Thomas Viehmann
b312b3fa38
fix libcuda_dirs import for triton 3.0 ( #227 )
...
* fix libcuda_dirs import for triton 3.0
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-06-13 18:37:57 +10:00
Alberto Ferrer
273a871c3b
llama.cpp failing ( #371 )
...
llama.cpp is failing to generate quantize versions for the trained models.
Error:
```bash
You might have to compile llama.cpp yourself, then run this again.
You do not need to close this Python program. Run the following commands in a new terminal:
You must run this in the same folder as you're saving your model.
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp && make clean && LLAMA_CUDA=1 make all -j
Once that's done, redo the quantization.
```
But when i do clone this with recursive it works.
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-06-13 18:16:20 +10:00
Sébastien De Greef
3fafbf7dc7
docs: Add LoraConfig parameters documentation ( #619 )
2024-06-13 17:30:37 +10:00
mahiatlinux
b5fc6aa008
Add GGML saving option to Unsloth for easier Ollama model creation and testing. ( #345 )
...
* Add save to llama.cpp GGML to save.py.
* Fix conversion command and path of convert to GGML function.
* Add autosaving lora to the GGML function
* Create lora save function for conversion to GGML
* Test fix #2 for saving lora
* Test fix #3 to save the lora adapters to convert to GGML
* Remove unwated tokenizer saving for conversion to ggml and added a few print statements.
* Needed tokenizer for saving, added it back, also made it more unslothy style by having positional arguments, and added a few messages.
* Positional arguments didn't work out, so reverted to older version of the code, and added a few comments.
* Test fix 1 for arch
* Test fix 2 new Mistral error.
* Test fix 3
* Revert to old version for testing.
* Upload issue test fix 1
* Fix 2 uploading ggml
* Positional ags added.
* Temporray remove positional args
* Fix upload again!!!
* Add print statements and fix link
* Make the calling name better
* Create local saving for GGML
* Add choosing directory to save local GGML.
* Fix lil variable error in the save_to_custom_dir func
2024-06-13 17:27:03 +10:00
Oseltamivir
9fdd847dab
Fixed unsloth/tokenizer_utils.py for chat training ( #604 )
2024-06-13 17:22:34 +10:00
XiaoYang
0428920ecd
Update __init__.py ( #602 )
...
Check for incompatible modules before importing unsloth
2024-06-13 16:57:23 +10:00
Rickard Edén
9016171682
clears any selected_adapters before calling internal_model.save_pretrained ( #609 )
2024-06-13 16:55:57 +10:00
Eliot Hall
dbf2dcff1a
Support revision parameter in FastLanguageModel.from_pretrained ( #629 )
...
* support `revision` parameter
* match unsloth formatting of named parameters
2024-06-13 16:53:29 +10:00
Eliot Hall
21a99f1d0c
fix case where gguf saving fails due to first_conversion dtype ( #630 )
2024-06-13 16:52:28 +10:00
Daniel Han-Chen
8176155d00
Update tokenizer_utils.py
2024-06-13 16:48:50 +10:00
Daniel Han-Chen
d704b732c4
Merge branch 'main' into nightly
2024-06-13 16:45:39 +10:00
Daniel Han
8a9e24ed4f
Ollama Chat Templates ( #582 )
...
* Update llama.py
* offload
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* continued pretraining trainer
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* is_bfloat16_supported
* Update __init__.py
* Update README.md
* Update llama.py
* is_bfloat16_supported
* Update __init__.py
* Mistral v3
* Phi 3 medium
* Update chat_templates.py
* Update chat_templates.py
* Phi-3
* Update save.py
* Update README.md
Mistral v3 to Mistral v0.3
* Untrained tokens
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update llama.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update save.py
* Update save.py
* Update save.py
* checkpoint
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update llama.py
* accelerate
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update tokenizer_utils.py
* train_dataloader
* Update llama.py
* Update llama.py
* Update llama.py
* use_fast_convert
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* remove_special_tokens
* Ollama
* Update chat_templates.py
* Update chat_templates.py
* Update chat_templates.py
* Update llama.py
* Update chat_templates.py
* Support bfloat16 GGUF
* Update save.py
* Update llama.py
* fast_forward_inference
* Update mapper.py
* Update loader.py
* Update llama.py
* Update tokenizer_utils.py
* info
* edits
* Create chat template
* Fix tokenizer
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2024-06-13 05:04:54 +10:00
Daniel Han-Chen
2a374c2368
Fix tokenizer
2024-06-13 03:25:36 +10:00
Daniel Han-Chen
8904605967
Create chat template
2024-06-12 06:30:12 +10:00
Daniel Han-Chen
8982edb6ea
edits
2024-06-11 20:21:28 +10:00
Daniel Han-Chen
893750707f
info
2024-06-11 19:53:29 +10:00
Daniel Han-Chen
f57d28d146
Update tokenizer_utils.py
2024-06-11 03:56:52 +10:00
