Datta Nimmaturi
9db2e12252
Throw error when inferencing longer than max_popsition_embeddings ( #1236 )
...
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-11-06 12:22:08 -08:00
Edd
89d851b8bc
Fix: cast logits to float32 in cross_entropy_forward to prevent errors ( #1254 )
...
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-11-06 12:16:02 -08:00
Daniel Han
6d85d43480
Merge branch 'main' into nightly
2024-11-06 12:13:56 -08:00
Daniel Han
685fd0ac50
Bug fixes ( #1255 )
...
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
* Update _utils.py
* fix/transformers-unpack (#1180 )
* Fix DPO, ORPO (#1177 )
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
---------
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Add warning for missing Unpack and KwargsForCausalLM in older Transformers versions
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* donot upcast lm_head and embeddings to float32 (#1186 )
* Cleanup upcast logs (#1188 )
* Fix/phi-longrope (#1193 )
* Enhance rotary embedding handling in LlamaAttention and LongRopeRotaryEmbedding
* Typo
* Improve rotary embedding handling in LlamaAttention to prevent errors with short KV cache
* Update llama.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update transformers
* Unk token issues
* Update _utils.py
* Fix pad token
* Update llama.py
* Typo
* ignored labels
* Revert "ignored labels"
This reverts commit 4b25138ac7#1219 )
* Update save.py
Check whether path is in /tmp dir for Kaggle environment
* Update save.py
Move temporary_location to /tmp in Kaggle
* Enhance Kaggle environment support in save and tokenizer utilities
---------
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
* Bug fixes
* Update pyproject.toml
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Tied weights
* Revert "Tied weights"
This reverts commit 820cd4efef
2024-11-06 12:08:55 -08:00
Daniel Han
105db16197
Update _utils.py
2024-11-06 02:10:37 -08:00
Daniel Han
083b71ca32
Update _utils.py
2024-11-06 00:18:04 -08:00
Daniel Han
bdfb2b993a
Update _utils.py
2024-11-05 22:48:36 -08:00
Daniel Han
9d5db6464e
Update _utils.py
2024-11-05 21:44:38 -08:00
Daniel Han
dbd0130065
Update _utils.py
2024-11-05 21:24:56 -08:00
Daniel Han
95c748752d
Merge branch 'main' into nightly
2024-11-05 21:24:47 -08:00
Daniel Han
de851836d5
Bug fix ( #1249 )
...
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
* Update _utils.py
* fix/transformers-unpack (#1180 )
* Fix DPO, ORPO (#1177 )
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
---------
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Add warning for missing Unpack and KwargsForCausalLM in older Transformers versions
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* donot upcast lm_head and embeddings to float32 (#1186 )
* Cleanup upcast logs (#1188 )
* Fix/phi-longrope (#1193 )
* Enhance rotary embedding handling in LlamaAttention and LongRopeRotaryEmbedding
* Typo
* Improve rotary embedding handling in LlamaAttention to prevent errors with short KV cache
* Update llama.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update transformers
* Unk token issues
* Update _utils.py
* Fix pad token
* Update llama.py
* Typo
* ignored labels
* Revert "ignored labels"
This reverts commit 4b25138ac7#1219 )
* Update save.py
Check whether path is in /tmp dir for Kaggle environment
* Update save.py
Move temporary_location to /tmp in Kaggle
* Enhance Kaggle environment support in save and tokenizer utilities
---------
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
* Bug fixes
* Update pyproject.toml
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Tied weights
* Revert "Tied weights"
This reverts commit 820cd4efef
2024-11-05 21:08:11 -08:00
Daniel Han
4594ae98e3
Update llama.py
2024-11-05 21:07:02 -08:00
Daniel Han
91a662d50c
Merge branch 'main' into nightly
2024-11-05 21:06:13 -08:00
Daniel Han
9c4c552a48
Update cross_entropy_loss.py
2024-11-05 21:01:33 -08:00
Daniel Han
c4cc2d8c48
Update cross_entropy_loss.py
2024-11-05 20:58:15 -08:00
Daniel Han
dbcbafa6c0
Update cross_entropy_loss.py
2024-11-05 20:29:30 -08:00
Daniel Han
ffc70682f4
Update _utils.py
2024-11-05 14:54:07 -08:00
Daniel Han
3616850a9f
Update cross_entropy_loss.py
2024-11-05 14:43:49 -08:00
Daniel Han
e66c0eb3ab
CE Loss
2024-11-05 14:40:57 -08:00
Daniel Han
e635bc4ea2
Update llama.py
2024-11-05 13:52:12 -08:00
Daniel Han
ed56a1daaa
Update _utils.py
2024-11-05 13:35:43 -08:00
Daniel Han
4806f58aab
Bug fixes ( #1245 )
...
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
* Update _utils.py
* fix/transformers-unpack (#1180 )
* Fix DPO, ORPO (#1177 )
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165 )
* chore: update chat_templates.py (#1166 )
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
---------
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Add warning for missing Unpack and KwargsForCausalLM in older Transformers versions
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* donot upcast lm_head and embeddings to float32 (#1186 )
* Cleanup upcast logs (#1188 )
* Fix/phi-longrope (#1193 )
* Enhance rotary embedding handling in LlamaAttention and LongRopeRotaryEmbedding
* Typo
* Improve rotary embedding handling in LlamaAttention to prevent errors with short KV cache
* Update llama.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update transformers
* Unk token issues
* Update _utils.py
* Fix pad token
* Update llama.py
* Typo
* ignored labels
* Revert "ignored labels"
This reverts commit 4b25138ac7#1219 )
* Update save.py
Check whether path is in /tmp dir for Kaggle environment
* Update save.py
Move temporary_location to /tmp in Kaggle
* Enhance Kaggle environment support in save and tokenizer utilities
---------
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
* Bug fixes
* Update pyproject.toml
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Tied weights
* Revert "Tied weights"
This reverts commit 820cd4efef
2024-11-05 13:29:37 -08:00
Daniel Han
102d8cccbf
Update pyproject.toml
2024-11-05 13:28:25 -08:00
Daniel Han
8d6d3b49c2
Update _utils.py
2024-11-05 12:05:17 -08:00
Daniel Han
cc0c4d824a
Update llama.py
2024-11-05 02:06:27 -08:00
Daniel Han
e1ed9c85a0
Update llama.py
2024-11-05 01:55:17 -08:00
Daniel Han
302fe3e8fe
Update _utils.py
2024-11-05 01:52:27 -08:00
Daniel Han
e61a58a7a6
Update llama.py
2024-11-05 01:42:44 -08:00
Daniel Han
7e596ea1be
Update _utils.py
2024-11-05 01:41:04 -08:00
Daniel Han
44b3006678
Forward hook
2024-11-05 01:36:11 -08:00
Daniel Han
34209e9160
Update _utils.py
2024-11-05 01:30:34 -08:00
Daniel Han
f207f39d63
Update _utils.py
2024-11-05 00:15:56 -08:00
Daniel Han
d53599209d
Disable compiling
2024-11-05 00:11:32 -08:00
Daniel Han
501e71f759
types
2024-11-05 00:09:11 -08:00
Daniel Han
62ed303345
Update rope_embedding.py
2024-11-05 00:08:16 -08:00
Daniel Han
15dbd771ec
typing
2024-11-05 00:05:56 -08:00
Daniel Han
16eb66ae47
Update rms_layernorm.py
2024-11-04 23:54:02 -08:00
Daniel Han
db36694eb6
Update rms_layernorm.py
2024-11-04 23:47:38 -08:00
Daniel Han
938f657781
Update rms_layernorm.py
2024-11-04 23:45:25 -08:00
Daniel Han
e1fecc0b73
Update rms_layernorm.py
2024-11-04 23:39:03 -08:00
Daniel Han
f8d6966e2a
Update rms_layernorm.py
2024-11-04 23:34:11 -08:00
Daniel Han
2de9091c04
Update rms_layernorm.py
2024-11-04 23:33:08 -08:00
Daniel Han
fa039eb57b
Update rms_layernorm.py
2024-11-04 23:30:55 -08:00
Daniel Han
98630427b8
Update rms_layernorm.py
2024-11-04 23:28:57 -08:00
Daniel Han
e5f6ba3f27
Update rms_layernorm.py
2024-11-04 23:27:50 -08:00
Daniel Han
d966cbd5ea
Update rms_layernorm.py
2024-11-04 23:24:33 -08:00
Daniel Han
71a3333c0f
Update rms_layernorm.py
2024-11-04 23:20:32 -08:00
Daniel Han
aa5668049a
Update rms_layernorm.py
2024-11-04 23:19:02 -08:00
Daniel Han
943cc1c3df
Update utils.py
2024-11-04 23:16:01 -08:00
Daniel Han
2cd4b8debd
Update rms_layernorm.py
2024-11-04 23:11:03 -08:00
