Commit graph

4,672 commits

Author SHA1 Message Date
Daniel Han
15268ba184 Bug fixes (#1245)
* Fix TRL

* Update mistral.py

* Patch processing_class

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Installation guide (#1165)

* chore: update chat_templates.py (#1166)

orginal -> original

* Disable Flex Attention

* Update tokenizer_utils.py

* Update _utils.py

* n_items

* Update cross_entropy_loss.py

* Fix DPO, ORPO

* Update _utils.py

* Update _utils.py

* fix/transformers-unpack (#1180)

* Fix DPO, ORPO (#1177)

* Fix TRL

* Update mistral.py

* Patch processing_class

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Installation guide (#1165)

* chore: update chat_templates.py (#1166)

orginal -> original

* Disable Flex Attention

* Update tokenizer_utils.py

* Update _utils.py

* n_items

* Update cross_entropy_loss.py

* Fix DPO, ORPO

* Update _utils.py

---------

Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>

* Add warning for missing Unpack and KwargsForCausalLM in older Transformers versions

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* donot upcast lm_head and embeddings to float32 (#1186)

* Cleanup upcast logs (#1188)

* Fix/phi-longrope (#1193)

* Enhance rotary embedding handling in LlamaAttention and LongRopeRotaryEmbedding

* Typo

* Improve rotary embedding handling in LlamaAttention to prevent errors with short KV cache

* Update llama.py

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update transformers

* Unk token issues

* Update _utils.py

* Fix pad token

* Update llama.py

* Typo

* ignored labels

* Revert "ignored labels"

This reverts commit 9d07be077b.

* More patching

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Feat/all tmp (#1219)

* Update save.py

Check whether path is in /tmp dir for Kaggle environment

* Update save.py

Move temporary_location to /tmp in Kaggle

* Enhance Kaggle environment support in save and tokenizer utilities

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>

* Bug fixes

* Update pyproject.toml

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Tied weights

* Revert "Tied weights"

This reverts commit 8090b7c01a.

* Tied weights

* Utils

* CE Loss patching

* Update __init__.py

* Update __init__.py

* Patching

* Update cross_entropy_loss.py

* CE Loss

* Update _utils.py

* Update _utils.py

* CE Loss

* Update _utils.py

* Update _utils.py

* Layernorm

* Update _utils.py

* Update _utils.py

* Post patch

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* typing

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* int64

* Update _utils.py

* Update cross_entropy_loss.py

* constexpr

* constexpr

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* CE

* Update cross_entropy_loss.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* typing

* Update rope_embedding.py

* types

* Disable compiling

* Update _utils.py

* Update _utils.py

* Forward hook

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update pyproject.toml

---------

Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
2024-11-05 13:29:37 -08:00
Daniel Han
5bb3e0d462 Update pyproject.toml 2024-11-05 13:28:25 -08:00
Daniel Han
09ad3757c9 Update _utils.py 2024-11-05 12:05:17 -08:00
Daniel Han
0f9b6390a6 Update llama.py 2024-11-05 02:06:27 -08:00
Daniel Han
250109be45 Update llama.py 2024-11-05 01:55:17 -08:00
Daniel Han
116f286d0c Update _utils.py 2024-11-05 01:52:27 -08:00
Daniel Han
c18bac88be Update llama.py 2024-11-05 01:42:44 -08:00
Daniel Han
ed61c33d2c Update _utils.py 2024-11-05 01:41:04 -08:00
Daniel Han
a184f38f7a Forward hook 2024-11-05 01:36:11 -08:00
Daniel Han
09c1f6d677 Update _utils.py 2024-11-05 01:30:34 -08:00
Daniel Han
b0f010259f Update _utils.py 2024-11-05 00:15:56 -08:00
Daniel Han
f627c1bf35 Disable compiling 2024-11-05 00:11:32 -08:00
Daniel Han
81a87cc262 types 2024-11-05 00:09:11 -08:00
Daniel Han
4076dc49cb Update rope_embedding.py 2024-11-05 00:08:16 -08:00
Daniel Han
0ab731d40b typing 2024-11-05 00:05:56 -08:00
Daniel Han
9384cb9f72 Update rms_layernorm.py 2024-11-04 23:54:02 -08:00
Daniel Han
0b2363bacd Update rms_layernorm.py 2024-11-04 23:47:38 -08:00
Daniel Han
6836e43f27 Update rms_layernorm.py 2024-11-04 23:45:25 -08:00
Daniel Han
eddf0c46f4 Update rms_layernorm.py 2024-11-04 23:39:03 -08:00
Daniel Han
bf97546a16 Update rms_layernorm.py 2024-11-04 23:34:11 -08:00
Daniel Han
4485a342e0 Update rms_layernorm.py 2024-11-04 23:33:08 -08:00
Daniel Han
34abdb309d Update rms_layernorm.py 2024-11-04 23:30:55 -08:00
Daniel Han
fd07c2ee73 Update rms_layernorm.py 2024-11-04 23:28:57 -08:00
Daniel Han
c35f115537 Update rms_layernorm.py 2024-11-04 23:27:50 -08:00
Daniel Han
d80444fe3e Update rms_layernorm.py 2024-11-04 23:24:33 -08:00
Daniel Han
40858e4f76 Update rms_layernorm.py 2024-11-04 23:20:32 -08:00
Daniel Han
a3429d208d Update rms_layernorm.py 2024-11-04 23:19:02 -08:00
Daniel Han
4e4bdc4fcf Update utils.py 2024-11-04 23:16:01 -08:00
Daniel Han
578c8fde96 Update rms_layernorm.py 2024-11-04 23:11:03 -08:00
Daniel Han
15fdce80b9 Update rms_layernorm.py 2024-11-04 23:08:05 -08:00
Daniel Han
106d35fe8a Update rms_layernorm.py 2024-11-04 23:06:13 -08:00
Daniel Han
9de3649586 Update rms_layernorm.py 2024-11-04 23:04:34 -08:00
Daniel Han
74e5310ba1 Update rms_layernorm.py 2024-11-04 23:01:14 -08:00
Daniel Han
08f6b3ac3c Update rms_layernorm.py 2024-11-04 22:38:47 -08:00
Daniel Han
1c8582dd34 Update _utils.py 2024-11-04 22:10:52 -08:00
Daniel Han
3524fb6fd9 Update llama.py 2024-11-04 22:08:49 -08:00
Daniel Han
344b32931f Update _utils.py 2024-11-04 21:47:48 -08:00
Daniel Han
1518da6eef Update cross_entropy_loss.py 2024-11-04 19:48:09 -08:00
Daniel Han
543d31f6ec CE 2024-11-04 19:45:10 -08:00
Daniel Han
72c568498a Update _utils.py 2024-11-04 17:56:16 -08:00
Daniel Han
a1b608e889 Update _utils.py 2024-11-04 01:23:24 -08:00
Daniel Han
1f0fd97f46 Update _utils.py 2024-11-04 01:20:31 -08:00
Daniel Han
80dea539a7 Update cross_entropy_loss.py 2024-11-04 00:32:35 -08:00
Daniel Han
287d50c257 Update cross_entropy_loss.py 2024-11-04 00:07:52 -08:00
Daniel Han
0c48e0c179 constexpr 2024-11-04 00:05:51 -08:00
Daniel Han
d2725e7910 constexpr 2024-11-04 00:03:24 -08:00
Daniel Han
006bafb437 Update cross_entropy_loss.py 2024-11-04 00:01:04 -08:00
Daniel Han
ffe5d81c4f Update _utils.py 2024-11-03 23:55:39 -08:00
Daniel Han
eaff11e1c3 int64 2024-11-03 23:53:03 -08:00
Daniel Han
5eddfd8cfe Update cross_entropy_loss.py 2024-11-03 21:42:13 -08:00