Daniel Han
|
15268ba184
|
Bug fixes (#1245)
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165)
* chore: update chat_templates.py (#1166)
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
* Update _utils.py
* fix/transformers-unpack (#1180)
* Fix DPO, ORPO (#1177)
* Fix TRL
* Update mistral.py
* Patch processing_class
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Installation guide (#1165)
* chore: update chat_templates.py (#1166)
orginal -> original
* Disable Flex Attention
* Update tokenizer_utils.py
* Update _utils.py
* n_items
* Update cross_entropy_loss.py
* Fix DPO, ORPO
* Update _utils.py
---------
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Add warning for missing Unpack and KwargsForCausalLM in older Transformers versions
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* donot upcast lm_head and embeddings to float32 (#1186)
* Cleanup upcast logs (#1188)
* Fix/phi-longrope (#1193)
* Enhance rotary embedding handling in LlamaAttention and LongRopeRotaryEmbedding
* Typo
* Improve rotary embedding handling in LlamaAttention to prevent errors with short KV cache
* Update llama.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update transformers
* Unk token issues
* Update _utils.py
* Fix pad token
* Update llama.py
* Typo
* ignored labels
* Revert "ignored labels"
This reverts commit 9d07be077b.
* More patching
* Update _utils.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Feat/all tmp (#1219)
* Update save.py
Check whether path is in /tmp dir for Kaggle environment
* Update save.py
Move temporary_location to /tmp in Kaggle
* Enhance Kaggle environment support in save and tokenizer utilities
---------
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
* Bug fixes
* Update pyproject.toml
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Tied weights
* Revert "Tied weights"
This reverts commit 8090b7c01a.
* Tied weights
* Utils
* CE Loss patching
* Update __init__.py
* Update __init__.py
* Patching
* Update cross_entropy_loss.py
* CE Loss
* Update _utils.py
* Update _utils.py
* CE Loss
* Update _utils.py
* Update _utils.py
* Layernorm
* Update _utils.py
* Update _utils.py
* Post patch
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* typing
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
---------
Co-authored-by: timothelaborie <97834767+timothelaborie@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
|
2024-11-05 13:29:37 -08:00 |
|
Daniel Han
|
5bb3e0d462
|
Update pyproject.toml
|
2024-11-05 13:28:25 -08:00 |
|
Daniel Han
|
09ad3757c9
|
Update _utils.py
|
2024-11-05 12:05:17 -08:00 |
|
Daniel Han
|
0f9b6390a6
|
Update llama.py
|
2024-11-05 02:06:27 -08:00 |
|
Daniel Han
|
250109be45
|
Update llama.py
|
2024-11-05 01:55:17 -08:00 |
|
Daniel Han
|
116f286d0c
|
Update _utils.py
|
2024-11-05 01:52:27 -08:00 |
|
Daniel Han
|
c18bac88be
|
Update llama.py
|
2024-11-05 01:42:44 -08:00 |
|
Daniel Han
|
ed61c33d2c
|
Update _utils.py
|
2024-11-05 01:41:04 -08:00 |
|
Daniel Han
|
a184f38f7a
|
Forward hook
|
2024-11-05 01:36:11 -08:00 |
|
Daniel Han
|
09c1f6d677
|
Update _utils.py
|
2024-11-05 01:30:34 -08:00 |
|
Daniel Han
|
b0f010259f
|
Update _utils.py
|
2024-11-05 00:15:56 -08:00 |
|
Daniel Han
|
f627c1bf35
|
Disable compiling
|
2024-11-05 00:11:32 -08:00 |
|
Daniel Han
|
81a87cc262
|
types
|
2024-11-05 00:09:11 -08:00 |
|
Daniel Han
|
4076dc49cb
|
Update rope_embedding.py
|
2024-11-05 00:08:16 -08:00 |
|
Daniel Han
|
0ab731d40b
|
typing
|
2024-11-05 00:05:56 -08:00 |
|
Daniel Han
|
9384cb9f72
|
Update rms_layernorm.py
|
2024-11-04 23:54:02 -08:00 |
|
Daniel Han
|
0b2363bacd
|
Update rms_layernorm.py
|
2024-11-04 23:47:38 -08:00 |
|
Daniel Han
|
6836e43f27
|
Update rms_layernorm.py
|
2024-11-04 23:45:25 -08:00 |
|
Daniel Han
|
eddf0c46f4
|
Update rms_layernorm.py
|
2024-11-04 23:39:03 -08:00 |
|
Daniel Han
|
bf97546a16
|
Update rms_layernorm.py
|
2024-11-04 23:34:11 -08:00 |
|
Daniel Han
|
4485a342e0
|
Update rms_layernorm.py
|
2024-11-04 23:33:08 -08:00 |
|
Daniel Han
|
34abdb309d
|
Update rms_layernorm.py
|
2024-11-04 23:30:55 -08:00 |
|
Daniel Han
|
fd07c2ee73
|
Update rms_layernorm.py
|
2024-11-04 23:28:57 -08:00 |
|
Daniel Han
|
c35f115537
|
Update rms_layernorm.py
|
2024-11-04 23:27:50 -08:00 |
|
Daniel Han
|
d80444fe3e
|
Update rms_layernorm.py
|
2024-11-04 23:24:33 -08:00 |
|
Daniel Han
|
40858e4f76
|
Update rms_layernorm.py
|
2024-11-04 23:20:32 -08:00 |
|
Daniel Han
|
a3429d208d
|
Update rms_layernorm.py
|
2024-11-04 23:19:02 -08:00 |
|
Daniel Han
|
4e4bdc4fcf
|
Update utils.py
|
2024-11-04 23:16:01 -08:00 |
|
Daniel Han
|
578c8fde96
|
Update rms_layernorm.py
|
2024-11-04 23:11:03 -08:00 |
|
Daniel Han
|
15fdce80b9
|
Update rms_layernorm.py
|
2024-11-04 23:08:05 -08:00 |
|
Daniel Han
|
106d35fe8a
|
Update rms_layernorm.py
|
2024-11-04 23:06:13 -08:00 |
|
Daniel Han
|
9de3649586
|
Update rms_layernorm.py
|
2024-11-04 23:04:34 -08:00 |
|
Daniel Han
|
74e5310ba1
|
Update rms_layernorm.py
|
2024-11-04 23:01:14 -08:00 |
|
Daniel Han
|
08f6b3ac3c
|
Update rms_layernorm.py
|
2024-11-04 22:38:47 -08:00 |
|
Daniel Han
|
1c8582dd34
|
Update _utils.py
|
2024-11-04 22:10:52 -08:00 |
|
Daniel Han
|
3524fb6fd9
|
Update llama.py
|
2024-11-04 22:08:49 -08:00 |
|
Daniel Han
|
344b32931f
|
Update _utils.py
|
2024-11-04 21:47:48 -08:00 |
|
Daniel Han
|
1518da6eef
|
Update cross_entropy_loss.py
|
2024-11-04 19:48:09 -08:00 |
|
Daniel Han
|
543d31f6ec
|
CE
|
2024-11-04 19:45:10 -08:00 |
|
Daniel Han
|
72c568498a
|
Update _utils.py
|
2024-11-04 17:56:16 -08:00 |
|
Daniel Han
|
a1b608e889
|
Update _utils.py
|
2024-11-04 01:23:24 -08:00 |
|
Daniel Han
|
1f0fd97f46
|
Update _utils.py
|
2024-11-04 01:20:31 -08:00 |
|
Daniel Han
|
80dea539a7
|
Update cross_entropy_loss.py
|
2024-11-04 00:32:35 -08:00 |
|
Daniel Han
|
287d50c257
|
Update cross_entropy_loss.py
|
2024-11-04 00:07:52 -08:00 |
|
Daniel Han
|
0c48e0c179
|
constexpr
|
2024-11-04 00:05:51 -08:00 |
|
Daniel Han
|
d2725e7910
|
constexpr
|
2024-11-04 00:03:24 -08:00 |
|
Daniel Han
|
006bafb437
|
Update cross_entropy_loss.py
|
2024-11-04 00:01:04 -08:00 |
|
Daniel Han
|
ffe5d81c4f
|
Update _utils.py
|
2024-11-03 23:55:39 -08:00 |
|
Daniel Han
|
eaff11e1c3
|
int64
|
2024-11-03 23:53:03 -08:00 |
|
Daniel Han
|
5eddfd8cfe
|
Update cross_entropy_loss.py
|
2024-11-03 21:42:13 -08:00 |
|