unsloth

Author	SHA1	Message	Date
Daniel Han	b462ab8ede	Tokenizers fix (#336 ) * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py * Update save.py * Update save.py * checkpoint * Gemma 1.1 * more models * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * dtype * Update llama.py * CodeGemma * Fix downcasting * Some bugs * Fix Yi tokenizer * HF_TOKEN * Update llama.py * Update tokenizer_utils.py	2024-04-15 04:18:01 +10:00
Daniel Han	488fb2f64c	Readme Changes (#324 ) * Update README.md * Update README.md --------- Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>	2024-04-11 01:43:34 +10:00
Daniel Han-Chen	00d5e3dff5	Update _utils.py	2024-04-10 00:51:06 +10:00
Daniel Han	5bfe1e3d9a	Fix downcasting LoRA (#318 ) * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py * Update save.py * Update save.py * checkpoint * Gemma 1.1 * more models * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * dtype * Update llama.py * CodeGemma * Fix downcasting	2024-04-10 00:44:58 +10:00
Daniel Han	4a4b7a9b74	CodeGemma (#317 ) * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py * Update save.py * Update save.py * checkpoint * Gemma 1.1 * more models * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * dtype * Update llama.py * CodeGemma	2024-04-09 23:35:02 +10:00
Daniel Han	ef99b2b019	Torch dtype (#314 ) * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py * Update save.py * Update save.py * checkpoint * Gemma 1.1 * more models * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * dtype	2024-04-08 23:19:46 +10:00
Daniel Han	0dc7729292	Fix Gemma GGUF (#311 ) * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py * Update save.py * Update save.py * checkpoint * Gemma 1.1 * more models	2024-04-08 01:28:00 +10:00
Daniel Han	cb7924e9db	Bug fixes (#308 ) * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side * Update tokenizer_utils.py * cache dir * Update tokenizer_utils.py * Update tokenizer_utils.py * Update pyproject.toml * Update pyproject.toml * Update tokenizer_utils.py * Update tokenizer_utils.py * Update llama.py	2024-04-07 03:44:45 +10:00
Daniel Han	4290c8a278	Bug fixes (#306 ) * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul * Update llama.py * Update llama.py * Update llama.py * offloaded checkpointing * Update llama.py * Update llama.py * Update _utils.py * Update _utils.py * Update _utils.py * Update llama.py * Update llama.py * Update gemma.py * Revert "Update gemma.py" This reverts commit e3c3c5f3fa3d04a87f854056f6b547ced610d712. * Update _utils.py * Update _utils.py * Update _utils.py * Saving * sentencepiece_model_pb2 * Update llama.py * Update save.py * Update llama.py * padding side	2024-04-06 04:31:24 +11:00
Daniel Han-Chen	b5200a33f1	Gemma inference fix	2024-04-05 03:51:53 +11:00
Daniel Han-Chen	3dbf8ff9c5	Update gemma.py eabdullin	2024-04-04 22:46:32 +11:00
Daniel Han	073bbdf48a	Nightly (#299 ) * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * lora mamtul	2024-04-03 05:38:31 +11:00
Daniel Han	bf5619378a	Fix batched inference (#298 ) * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py * Fix inference * swiglu * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * fast inference * model * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update llama.py * Update utils.py * inference * Update llama.py * Update llama.py * Update llama.py * overhead * Update llama.py * Update llama.py * compile * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py	2024-04-03 04:56:11 +11:00
Daniel Han-Chen	31332433e9	Revert "Temp fix batch inference (#294 )" This reverts commit `cb20ab5b91`.	2024-04-02 13:18:31 +11:00
Daniel Han	cb20ab5b91	Temp fix batch inference (#294 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit * Update mistral.py * Update mistral.py * Stats * Update mistral.py * attention_mask * Update llama.py * Update llama.py * batch * Temp fix batch inference * Update llama.py * Update gemma.py	2024-04-02 04:35:28 +11:00
Daniel Han	634a9e0aa3	Nightly (#293 ) Env checking	2024-04-01 04:38:12 +11:00
Daniel Han	d0759aa52e	Auto Healing Tokenizer (#283 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py * Patch tokenizer * Update chat_templates.py * Heal tokenizers * Update chat_templates.py * Update mapper.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update tokenizer_utils.py * Update chat_templates.py * tokenizer patching * patch_tokenizer * Update chat_templates.py * Update tokenizer_utils.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update tokenizer_utils.py * Edit	2024-03-28 04:16:50 +11:00
Daniel Han-Chen	9e0d607cca	Update mapper.py	2024-03-24 14:00:04 +11:00
Daniel Han	928b05d576	lm_head issue (#266 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py * Update llama.py	2024-03-20 04:48:15 +11:00
Daniel Han	53d1f91ea4	Fix Saving (#264 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * state_dict * Update save.py * whoami * Update llama.py * Update save.py	2024-03-19 19:55:02 +11:00
Daniel Han	7db111f97b	Fix GGUF and saving (#261 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code * lm_head * Update llama.py * save_pretrained_settings * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py	2024-03-19 04:32:28 +11:00
Daniel Han	c31767869e	Fix lm_head, embed_tokens (#258 ) * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py * Update __init__.py * Update fast_lora.py * dtype * Update llama.py * Update llama.py * Update llama.py * dtype * Update mistral.py * trust_remote_code	2024-03-18 04:18:15 +11:00
Daniel Han-Chen	448e57b6b2	Update fast_lora.py	2024-03-17 22:46:44 +11:00
Daniel Han-Chen	cee52de544	Update fast_lora.py	2024-03-17 22:46:17 +11:00
Daniel Han-Chen	a583859642	Squashed commit of the following: commit 26b15e72f36f1a2ddb73e5121930b66d4d3bfe3f Merge: 37251d1 `e875e92` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 22:12:44 2024 +1100 Merge branch 'main' into nightly commit 37251d1338c020f0e011e31e7e053fbff841acc2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 22:12:18 2024 +1100 Update __init__.py commit c7cda1f250741ab45785fe0d7d990712488bab6b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 22:09:23 2024 +1100 Update fast_lora.py commit ee0241ceb313caaf2c4bab5621708ade2b630661 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 22:08:33 2024 +1100 Update pyproject.toml commit 726a6f179c5d47c1f0fdbea1a03435999a452ba3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 20:18:00 2024 +1100 Update fast_lora.py commit 9b944cb0972d1e01f1fd476928cd73be0fcf4418 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 20:10:30 2024 +1100 Bugs commit 6e567248ad659f742ad7e8d1cd7bad070fdd7e34 Merge: e2c820f `39ae3c6` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 20:10:26 2024 +1100 Merge branch 'main' into nightly commit e2c820fd1154959f497cc41a2622b475cf7ae77f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 02:46:35 2024 +1100 Update README.md commit 0700a2a17d5f92c8a1de089f932f2731512826b7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 17 02:44:58 2024 +1100 Update README.md commit 33d98a7abd272e8d5c3fabccc195f886339dab77 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 23:17:35 2024 +1100 Update save.py commit ea44bec836fa8c5d8f46ad4386b1c564ab7f1c93 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 22:36:57 2024 +1100 Update save.py commit 341704fd173d95c55c108839ec525f0d15694e03 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 22:31:02 2024 +1100 Update save.py commit f8c50c8cb82b98ffc831a1dfb85f755352c78ee2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 20:32:12 2024 +1100 Update save.py commit b9fe3635e17ece8a8a7700542cdf9bb2d07b8285 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 20:03:51 2024 +1100 GGUF commit be12e10fab6c53b0abe7317e08359c6e8f968b41 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 04:40:21 2024 +1100 Update README.md commit d7c340fc63dc5e75fb1341f95f8bb9254ebcdbf9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 04:34:51 2024 +1100 Update README.md commit 65419894fb220465981173125500149680405408 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 04:10:54 2024 +1100 Update fast_lora.py commit 4f8e947eec21e0911a66d39442a1e3c0dc3c32cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 03:43:16 2024 +1100 Update fast_lora.py commit 481f3746db9592ba3e9f39c10995ad121dfff43e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 03:38:13 2024 +1100 Fix bugs commit 3e45973853dd18f0cd979af456707e17a7224bc5 Merge: 94ddb9b `bcb0759` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 16 00:14:02 2024 +1100 Merge branch 'main' into nightly commit 94ddb9bdc20dfe783997eb50f9a08ef7eb66f231 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 22:35:44 2024 +1100 Update rope_embedding.py commit a355dba9ff60a044ea2e97d8fff822a3adab3b08 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 20:14:56 2024 +1100 Update rope_embedding.py commit 8ce8c1d5810ca250165a3162aa31d9454ac717f5 Merge: 2b7fc89 `c545fee` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 19:50:20 2024 +1100 Merge branch 'main' into nightly commit 2b7fc8909c5ba137f907dc336dbebfd22dae7971 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 19:50:03 2024 +1100 Update pyproject.toml commit 440c462e778d666b04ba564e589441bcbfa20cd2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 19:49:09 2024 +1100 Update pyproject.toml commit df8bf3c18d3f19b7025257932f14366f77a3763f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 19:48:39 2024 +1100 Update pyproject.toml commit e039870702f6d7a096564c4ea47979bb1d34e891 Merge: e1ae2c0 `012db22` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 05:07:09 2024 +1100 Merge branch 'main' into nightly commit e1ae2c0c68e1cd4ebbeb08d1a97593f7a8ba294a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 04:44:54 2024 +1100 Update chat_templates.py commit c3d01191bc30e34f49d250ea2b914596cbc23bea Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 04:30:03 2024 +1100 Update chat_templates.py commit 7b80682351cadc4cf55b43feba93af3645b6924e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 03:50:32 2024 +1100 Update chat_templates.py commit d90e72739939c817c31c356cbe98323e28076ed7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 03:37:37 2024 +1100 Update chat_templates.py commit 8be92c1f53aeaf55517064c4ac7f98fc6d3edc05 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 15 03:34:32 2024 +1100 Update chat_templates.py commit 41d37e0af16b4c853b7f5588098731b6481befd7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:27:20 2024 +1100 Update pyproject.toml commit 68b9c3ad55cf86ed433a52859847067c235a05b7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:20:16 2024 +1100 Update pyproject.toml commit ea5dd4ace296b6385b58a1fd419168d4b3b089a2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:12:54 2024 +1100 Update pyproject.toml commit 097294e25139dd849a285638a837be1d672cce8b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:12:02 2024 +1100 Update pyproject.toml commit 5fcc86983d14359e6118df8c634dbbae726d0fd4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:11:24 2024 +1100 Update pyproject.toml commit 1d2c42cd27f529d9c6c9c1a8754cc0cd1765568d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:10:10 2024 +1100 Update pyproject.toml commit 5c0aebf1c936efa932cbb39e355da3e43badf061 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:06:05 2024 +1100 Update pyproject.toml commit b8081d22236868e6d851ff72e5a6c4d4540d393d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 20:04:01 2024 +1100 Update pyproject.toml commit b07bccc3e393f3239b20799923b413ad10f1e697 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 14 19:02:29 2024 +1100 Fix Colab commit fcceed97be024288e238b9225e9258a83e8c917f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 12 20:12:55 2024 +1100 upcasting commit 62115acc3e87d18d92f5007c80144bdd17ab8d38 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 12 00:46:57 2024 +1100 Update pyproject.toml commit 538259b70b4e9a4304578a0d676d0e10d592f52e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 23:28:03 2024 +1100 Update pyproject.toml commit 4c8f91eee9ab8294a95ba6c1f9eebac2f7ad3260 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 23:21:27 2024 +1100 kaggle new commit 536e22f594f71885450d594c607066eeca768dcf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 20:28:09 2024 +1100 Update pyproject.toml commit b9f293964a31c1723a5f8dd38c7759b217f7c94a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 20:05:06 2024 +1100 Update save.py commit 93538b916cb6d47f754fe63dd730e3883110781e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 19:52:18 2024 +1100 GGUF incorrect commit d02dd551ea5a8505addc033256d582248c2d19f8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 19:13:42 2024 +1100 Update save.py commit bfd5d092a14936778e26dce8522b5b94202bde6f Merge: a36eca9 `424ffbe` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 19:13:29 2024 +1100 Merge branch 'main' into nightly commit a36eca9f0dc05cbd49946a719a79877aad3b471a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 04:05:43 2024 +1100 Update llama.py commit ba8b916adb97db8aa875c6d032cbe242c889e5b6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 03:53:23 2024 +1100 Account for DoRA commit f7fc17632c92a7b95b1b90b0adf8b96cb43789f0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 03:19:20 2024 +1100 Update llama.py commit 83583f629d5e321d53dbf09a55c310227e75ea36 Merge: 08d0041 `874b38d` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 03:15:30 2024 +1100 Merge branch 'main' into nightly commit 08d00410c68304483da6db39c32f8832d379889d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 03:07:44 2024 +1100 Update llama.py commit 381c5cd9f6d97643e5ecc229b093b9972af83bff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 02:25:10 2024 +1100 Update save.py commit 58ba3b68f473e892870fb401a77e62bd4feef6a9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 02:15:33 2024 +1100 Update save.py commit f5059e80bce2d5359c7cd573c2034f02b070563c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 11 02:10:51 2024 +1100 Update chat_templates.py commit 59cf41594d2aaa3b17f212d7c6828ef1ebe28f08 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 19:32:02 2024 +1100 Update fast_lora.py commit 3e0161952497524695d769c7d547295f0a6038b8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 19:11:00 2024 +1100 Update fast_lora.py commit adffab5ea32ce6bdfc57ae2422b84389e5dbf7d6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 19:09:10 2024 +1100 Update fast_lora.py commit 9acab293cf8fa1eb5a105e01bc9a0b8b42254529 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 18:36:35 2024 +1100 Update fast_lora.py commit f3d3a8e9b32ed715bcb5e6076d61a471d772c31e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 18:33:52 2024 +1100 Update fast_lora.py commit 3b54695168c389fc0b10f1fddffcd90b5d9ec0a4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 18:09:58 2024 +1100 Update save.py commit 92c3f5f7c9da7b059ddf3fa4b19853c7b46ae1d3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 17:42:41 2024 +1100 Revert commit 7e9cdf13eb8c136274ae7e53b4834330a3b17ff3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 16:20:20 2024 +1100 Accuracy commit a9aaa8902077b44c9238fc4c00c8784362602646 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 14:13:53 2024 +1100 Update save.py commit 17cee6f614f3cff4429b4f13ba1d7e1257389b37 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 14:08:38 2024 +1100 Update llama.py commit f32af374aef901d3ad97d2d2345d4bafb263cccf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 13:11:42 2024 +1100 Update llama.py commit 157b068e91b5f96191568828da7d8e26f0fff5eb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 13:10:03 2024 +1100 Update llama.py commit 24cf48dc4be1d350cf1a37091b46a699d42d088d Merge: 48b01d1 `67267ea` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 13:08:23 2024 +1100 Merge branch 'main' into nightly commit 48b01d1b5ef9f2cb6d56cac6499a35aead8b7ab4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 04:31:40 2024 +1100 Tokenizer overwritten commit 52d6ae2e5937e810b9cc18797f46557fa1a7e5a5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 04:08:02 2024 +1100 Update loader.py commit ff6a54048e43cfb7570716ee76866f3c19e0e0cc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 03:54:18 2024 +1100 model_name commit f665817aa3b0200d2080eeb036900bdd90cf9453 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 03:48:05 2024 +1100 Update llama.py commit 421be84fc860dde6ee223f2ed754ad2340780679 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 02:57:41 2024 +1100 Update chat_templates.py commit bf7d81829483e0ef5fce15ee75e88c106a1b3517 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 10 02:55:07 2024 +1100 Update save.py commit 3c31853a85c95e316c922fb7ebd6ee211f55c3cc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 9 23:22:14 2024 +1100 Update save.py commit c28e3bc3a82d2a4152755f8bc85ddc54e81886ae Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 9 23:19:02 2024 +1100 Update save.py commit 119d834050e6ea671fd6b313ae740f5d2c7023fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 9 20:05:52 2024 +1100 Update chat_templates.py commit 7d84b1febed25a05df2d9a972dd1de4c3e3cff8b Merge: 8339760 `2a342cc` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 8 19:40:25 2024 +1100 Merge branch 'main' into nightly commit 8339760c3fbd083a77eb1a970ffdc78f6204536f Merge: a818c52 `2104dc9` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 7 04:32:51 2024 +1100 Merge branch 'main' into nightly commit a818c52f4ad52ecb25a2ab11c383539ce91739e5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 7 02:48:15 2024 +1100 Update chat_templates.py commit e40221bb171708f4003081da732a6fb5a9ed256f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Mar 7 02:05:38 2024 +1100 Fix warning commit 097b7213d1e39531771d55d200a6f38d13fa4e77 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 19:21:44 2024 +1100 Update rms_layernorm.py commit fb62ad2b982e64ad50031becdb945040935c6b09 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 18:18:07 2024 +1100 RoPE and Gemma precision commit 18ba5dca306537ac6feff99a13ab8e63a77b83e3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 05:07:37 2024 +1100 Update save.py commit 094ed56452a2ed23e6c646816f64374ea7344e61 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 04:52:59 2024 +1100 Update gemma.py commit cc8d0617c403cb52d4a39e763f07d17d2a11d06d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 04:48:26 2024 +1100 sqrt commit 19aeb12c2114015ebb6e0543a7bdb63fa3d8e436 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 04:24:10 2024 +1100 Update gemma.py commit 9fea6262f3b778b820f28de67034f49251007db9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Mar 6 04:14:11 2024 +1100 Gemma precision commit 823d21161694310286b3d5a3438ec53932f1ddc1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 23:58:00 2024 +1100 Layernorms commit b6ace5579403989a362f7506808dde46e2e1c1f3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 20:07:44 2024 +1100 Update pyproject.toml commit c40a02702c0bd23dd50c50d3b0acffd325788548 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 18:55:50 2024 +1100 Update gemma.py commit 13aadd3b2d9e62b04235f62cfb9e70d4f64d573f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 18:27:11 2024 +1100 Update rms_layernorm.py commit 50a5f76ef9bc8447983b6075fd02809abe5a6059 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 18:21:59 2024 +1100 Fix Gemma merging commit 7aca45abb2fc7b4ce1c4e2be480cf9eec8a645d4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 02:41:56 2024 +1100 Update gemma.py commit 612644ebb98a05e6df4a9c9f6bf023d3099e0b3a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 02:40:20 2024 +1100 Update gemma.py commit fc00e714bd9f67f60c064e6581127d5a2513b16d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 02:22:31 2024 +1100 Update gemma.py commit 14f16700d74ff358f01a12f64fe0b84199cdc231 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Mar 5 01:45:08 2024 +1100 Update gemma.py commit 1900bda4e007e39d0ef406f87037a84abf9ab725 Merge: bfd32ab `8e8bb99` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 4 16:19:13 2024 +1100 Merge branch 'main' into nightly commit bfd32ab22513c5f0609153770d25ce6636c38c8b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 4 16:14:50 2024 +1100 Update gemma.py commit 23c863bc8da3cc9a541734a61d4a697b6ac9c033 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 4 16:11:12 2024 +1100 Update rms_layernorm.py commit 15589f94e0663591e2c17f5fbebade80b78d48cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 4 16:04:29 2024 +1100 Update rms_layernorm.py commit 12cd0e06dd1168cb149af13e53e0cb819847d11c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Mar 4 16:00:35 2024 +1100 Update rms_layernorm.py commit 7aa18817094b1ed5a10fbf239878d6d7ac519b22 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 19:32:18 2024 +1100 Update gemma.py commit 93b2f43254e0f792ac5e408e44fb619b1bbed1b0 Merge: 0d09122 `05a2d7d` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 19:29:41 2024 +1100 Merge branch 'main' into nightly commit 0d09122a1d59509f2c6831783caa9c8d98d59ed3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 18:07:55 2024 +1100 Update geglu.py commit 3a4210362e2a3c206b500152c3ec68a99df6dd73 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 03:39:36 2024 +1100 Update _utils.py commit a51d09de9802dc7ef4379b6a47fdfdaeaebf7970 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 03:39:10 2024 +1100 Update __init__.py commit f35aaa3b79a684abff4c4ffc240cb559c879d88d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 03:37:43 2024 +1100 Update __init__.py commit 40e183076840f8041cd0262cc02f97e98a12045a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 03:35:21 2024 +1100 Update llama.py commit 02760f5498a5d954e27e331892b7b8b7641f5511 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 03:17:59 2024 +1100 Approx gelu commit 2b81ad11752e79f81127c156b75fca1f1cb0fedc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Mar 3 02:24:39 2024 +1100 Update geglu.py commit 8ab193d5c3152599e1e947cf4e48b8968e93ca0c Merge: 5810d90 `851ab78` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 2 18:29:02 2024 +1100 Merge branch 'main' into nightly commit 5810d9057d798902a342446f0dce2bbbc29ed002 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 2 18:28:39 2024 +1100 Approx gelu commit fd18940b44444370c413dfea335509a999706002 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 2 02:39:11 2024 +1100 Update pyproject.toml commit 030f0f0de5dd798fb9a322033614162d595b6bfa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Mar 2 02:38:40 2024 +1100 Small fixes commit a8b578b64b6f1cb7286b5451df4f7b15485eaa37 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Mar 1 04:16:25 2024 +1100 Update pyproject.toml commit 8a6bb958d06dd0c38bf927110f556aaaccd3ad7d Merge: 1ade399 932f7f0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:17:47 2024 +1100 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly commit 1ade399f767b09c4113ddaf64d316c150f14f20e Merge: 05ebcd5 `727fb33` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:17:12 2024 +1100 Merge branch 'main' into nightly commit 932f7f05149ad49537e8a13ad6ccd100648e0689 Author: Daniel Han <danielhanchen@gmail.com> Date: Thu Feb 29 00:17:03 2024 +1100 Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py commit 05ebcd501eb5c29082e9a646c18f0ca5dfa45d55 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:16:19 2024 +1100 Update llama.py commit 9228789bd49f212fc2ee06379af6a3d438a5efe0 Merge: 31bb9ce `daac342` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:14:42 2024 +1100 Merge branch 'main' into nightly commit 31bb9ce8ddf30c33d91deeba053c850eb7c94a29 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:09:00 2024 +1100 Update chat_templates.py commit fecaeb7ecdf76cb25c5d05c6ab9d4e655fecc4c4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 29 00:02:40 2024 +1100 Update _utils.py commit d94a1dee806487ed7af0b500634212520f853606 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 28 23:59:49 2024 +1100 DoRA commit ea45c4f41c3f9c75367f9e8acd3a574f9b3cddbd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 28 22:02:18 2024 +1100 Update llama.py commit 72ef949f4b99c502d95f856e791c2607e5e16d23 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 27 01:40:45 2024 +1100 Update README.md commit 0eb0517b135830fff8c03265193159ca736591de Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 27 01:39:52 2024 +1100 Update README.md commit da4085857c5402cfeaf5b3f6228645d9991aef9d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 27 00:16:57 2024 +1100 Chat Templates commit 4c62f0f50dcb484ba026402e43690da66e56b2df Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 17:27:42 2024 +1100 Update cross_entropy_loss.py commit 803316ec68e3ebb03ec718d9db660900fa76edb9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 16:19:39 2024 +1100 Update cross_entropy_loss.py commit edcb2420ac27de2b86e3e9a2fa3b2c6202575e66 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:44:22 2024 +1100 Update gemma.py commit 2bf5d4b9097bc9df4fbe460bfc678d3273a8d2fa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:39:43 2024 +1100 correct_dtype commit 2293813d737638579df5f9d3c55b5a3201cf2016 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:38:27 2024 +1100 Update gemma.py commit 3cfba145aaef81702b37f9d8574bc2ec3b302e18 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:37:48 2024 +1100 Update llama.py commit f2718b956d62dfa587415308677d317ef7090f84 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:37:09 2024 +1100 Update llama.py commit 02d04903e41ca754196549b2265b2a7a3042765d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:36:39 2024 +1100 Update llama.py commit 85ca313468688f0556a45cf22c0f878b7ceea152 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:35:44 2024 +1100 RoPE commit 91d311354c88b2abccef5660cfbe83c56e4d2366 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 14:15:37 2024 +1100 Update save.py commit fd725b53fcb7c26cd16179fedaf37b15a796b5a6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 05:06:04 2024 +1100 Update gemma.py commit 6846d4a8348d2e2e9bfb62be97b60da7bce318fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 05:05:41 2024 +1100 Update gemma.py commit cf72225065a505d4fd5461b77b1f9bd66e1e32cc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:37:12 2024 +1100 Update gemma.py commit b540e71a685dfae3fcc1ba3cfb1adc9e7f336eee Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:36:10 2024 +1100 Update gemma.py commit a61ffc3fdb6c7be02570a413ee138f4f54a603fe Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:32:49 2024 +1100 Update gemma.py commit f61d0158429f9c4e532ce39ad27162d5b5109df8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:30:29 2024 +1100 Update gemma.py commit ae9a6d893a6217514e020885b68061ad13203b2e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:27:55 2024 +1100 Update gemma.py commit cdd03568dfc24e118a145b4941ceecf0337bcfff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:23:38 2024 +1100 Update gemma.py commit 89927e32536178ef8ec31ca775ee7f27b4ffea30 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 04:20:19 2024 +1100 Update gemma.py commit 542e39aeedcb08b087f6e5a1d0ce6121ac98c177 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:56:34 2024 +1100 Update gemma.py commit 9af615a7b84e0dee7f0f5af9661f381752308a53 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:55:15 2024 +1100 Update cross_entropy_loss.py commit 4cd705ab766446d9de6d1ec3c18b129aa543b251 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:53:49 2024 +1100 Update cross_entropy_loss.py commit bb1ae97d1c4fb64595a29dade51dcb4fa9ec4698 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:50:34 2024 +1100 Update cross_entropy_loss.py commit 0b95738111f301c98be755bee2f4dfa349422642 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:48:16 2024 +1100 Update cross_entropy_loss.py commit 7d736d96c145b1c00780201eb83070878148bc64 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:46:18 2024 +1100 Update cross_entropy_loss.py commit 8d24d26c64a6e1a2103dd44ee110b92e2b0d8264 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:43:22 2024 +1100 Update cross_entropy_loss.py commit 3b0dab7ea4560f270b41b4d1abebcd0a8231d72a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:36:38 2024 +1100 Update cross_entropy_loss.py commit 16fa1f74df57110b10ec918c34a8aad1633340f9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:35:45 2024 +1100 Update cross_entropy_loss.py commit 1b9850896a934031df94feca6a4fd193dddcf4e1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:29:19 2024 +1100 Update cross_entropy_loss.py commit ccbf8aff7cc3408af63e27ba4ccded7c0e33f0d1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:29:11 2024 +1100 Update cross_entropy_loss.py commit 540f7473154fc8f9fbc202996b0fbbbafffcb284 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:28:22 2024 +1100 Update cross_entropy_loss.py commit ac77aa62e64a63e7f7ae9fc1d9432a4ec1a5bfd3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:26:42 2024 +1100 Update cross_entropy_loss.py commit c02e13cdf6e3b5e404b789dca2ac78c1b497c5d5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:19:26 2024 +1100 Update cross_entropy_loss.py commit da1f93a2b47c6c91f46b484de8fc829e3490cacd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:18:01 2024 +1100 Update cross_entropy_loss.py commit d4bba9c61ee720daa91e106dc5187da7ace9fe13 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:16:31 2024 +1100 Update cross_entropy_loss.py commit 6a0a798355f682948fe64409ba350caa789d9d9b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:15:19 2024 +1100 Update cross_entropy_loss.py commit 072d7a1a6ff0970b400c5622cf0745a0d68f739b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:14:04 2024 +1100 Update cross_entropy_loss.py commit 4f2f335f3e3ccc015bbdd0bb6b5e9c108714b02b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:12:23 2024 +1100 Update cross_entropy_loss.py commit 54d72b41b004cc6b090b183cc04bc316bfb7a5ff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 03:09:37 2024 +1100 Update cross_entropy_loss.py commit bd0cf55a5860e60235b3a9bfc426912d34b9fdb4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 26 02:49:02 2024 +1100 gemma commit b3f8c99644ceb8a6d57f46ac57b6c480036d7f96 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:48:34 2024 +1100 Update llama.py commit 81cac1de09aa39ac9aa9446d2e49e023d45c1907 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:47:45 2024 +1100 llama commit baff64ac26fe2bae27cb3e4538ab0f30bf04b25c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:35:39 2024 +1100 Update gemma.py commit 1ca7b5d04af490413a1d2cb5b1933940bf0f7706 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:30:59 2024 +1100 Update gemma.py commit fda25bdc552eb8854d1c201fbc2d8e36502144fb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:29:01 2024 +1100 Update gemma.py commit ce0c1ed4cf01943e07fdd06722d9465ebefdae65 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:25:57 2024 +1100 Update gemma.py commit c7a4aecf03e18679458dbb71423b9fbd9156e989 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:25:15 2024 +1100 Update gemma.py commit c163435d1d52f4112bb14a6a10bb30ff08511fc4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:22:35 2024 +1100 Update gemma.py commit ef38ef94ef4203026864a34f98e462788d6b0927 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:21:03 2024 +1100 Update gemma.py commit a5288f8bab26f5b9e0763251d65fd32e5f3b7d84 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:20:54 2024 +1100 Update gemma.py commit 1e1872f227037ae80ecbab6d5ade3c321423967c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:20:09 2024 +1100 Update gemma.py commit 1292636a9693bd0d96b2a3caa464168b39f75d28 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:18:23 2024 +1100 Update gemma.py commit ffcd02338595629077c01efb1b3219fb8a9a1d85 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:17:16 2024 +1100 Update gemma.py commit ff6ca4fd0228f97efc35d578219bf6affc2c0bb4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:14:57 2024 +1100 Update gemma.py commit 5502638a0974989a7cc5bf4f59987daa5eaebcda Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:14:38 2024 +1100 Update gemma.py commit 53f95aa7d40c00bb0b41de8ca88a6770341f0678 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:08:04 2024 +1100 Update gemma.py commit 5abac515e14af43127deb57ddc270ad31e206f53 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 04:07:47 2024 +1100 Update gemma.py commit eed6921c09924a99c89d70b1f84e8eb8ca1e996f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:55:44 2024 +1100 Update gemma.py commit 91947b3dfb376d4c379435610daa7ed94c73539f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:53:40 2024 +1100 Update gemma.py commit e091ab89a371c9c46c1357b6bc0883f028263a60 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:51:32 2024 +1100 Update gemma.py commit 8638c210dfe2964e9db5dd30a8d60ba951c459f0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:50:59 2024 +1100 Update gemma.py commit ac6e73bdbd4ad63c103e12aeae6a25f7447712c9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:49:55 2024 +1100 Update gemma.py commit d6d6846f18845e29996d670e1f54ad60530bdfe8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:44:22 2024 +1100 Update gemma.py commit 2a5e8149d0ed3c7088fa3e34250b8adb55f164c4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:39:40 2024 +1100 Update gemma.py commit f68b5098f14bf8e867f3ebd092af5a82964aee97 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:39:31 2024 +1100 Update gemma.py commit 38cfd53aa50f01f8620ac6b3eab174c79fc66ef3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:38:18 2024 +1100 Update gemma.py commit 5e88fd4a4311d21b9649b07f5c23d58aa2e9a58d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:37:30 2024 +1100 Update gemma.py commit 1ab85be2e224802ab031ce4b33e982a4ad1a1e3c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:32:23 2024 +1100 Update gemma.py commit b4340d9436be053b3e4e349cfd0d57b853111326 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:22:24 2024 +1100 Update gemma.py commit 9bd32736195eeddca5961c5a6bd6cb45a0315428 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:21:37 2024 +1100 Update gemma.py commit 9bebee5f129a0d4adc289a457e007cc7a0f9262b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:19:34 2024 +1100 Update gemma.py commit f4b26572cf21d0aebd0bf8196b2ddc5b4650d1dc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:16:55 2024 +1100 Update gemma.py commit a0dd4c162337f27652bd4fd903ca7fc26a6c794e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:16:34 2024 +1100 Update gemma.py commit 3d1ddd68bd0b8aef59b186cc49360f6c0b03c12d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:14:02 2024 +1100 Update gemma.py commit 24a1722b04eef541828d408545e03c9a1e066fe4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:13:18 2024 +1100 Update gemma.py commit 3f8b14a44f5e7428394a6d7aad7cb167693aeda2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:12:07 2024 +1100 Update gemma.py commit 426c7a2ab4eba6b508297031a6a226b4bd29c142 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:11:20 2024 +1100 Update gemma.py commit 51ea6904b35bd4dde1537aab150c63b32da81534 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:07:20 2024 +1100 Update gemma.py commit bef0001ffa72b10ff8c43d7e8410554897b87d09 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:03:31 2024 +1100 Update gemma.py commit d67d9eea729845bbfdb2fca80e97c600fe55e7b1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:03:23 2024 +1100 Update gemma.py commit 273fc217944f104ee6fb175f6ca1eec0bab26d40 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:01:56 2024 +1100 Update gemma.py commit 980cb21a6f90489e849a1c28cc108b1ce4c97d07 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:01:30 2024 +1100 Update gemma.py commit 501017d654f5f8edf29b3233cbe2a83810ba8c7a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 03:00:22 2024 +1100 Update gemma.py commit d972829dff658304087bfe82dbf33720c053993a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:49:14 2024 +1100 Update gemma.py commit 6220bd177ab66c282dfe2ac35d6838a71fd1eff6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:42:56 2024 +1100 Update gemma.py commit a1bb97f5e23ec10c31d27223c1796a198d9b621c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:41:24 2024 +1100 Update gemma.py commit 00ff7e1ef4b52563d1dd331864e6eb9d24c08fac Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:37:48 2024 +1100 Update gemma.py commit d133be2f4c04f0eb2034126c989b52f1bec3ce2a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:34:18 2024 +1100 Update gemma.py commit 5221f839c39175b3a756ba3367dec9d09f8f16f9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:31:22 2024 +1100 Update gemma.py commit 2682d1f51690d897f29bf87a83374f7e22154916 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:30:06 2024 +1100 Update gemma.py commit 17da8e003f80cd87b93f9c8c1ba9f61c7d26f79c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:28:01 2024 +1100 Update gemma.py commit bf9818d723d22d9dceaffcaf01065b236e1e6a6b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:26:57 2024 +1100 Update gemma.py commit 97d03d18b79830c9e807ec7d9f71054f701e2988 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:25:39 2024 +1100 Update gemma.py commit 47c5581892237d8771fe6c8caf3abc9eff234c86 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:18:43 2024 +1100 Update gemma.py commit a171892e3d96c26fc998683edb7c289165c37a67 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:17:45 2024 +1100 Update gemma.py commit c836259e84ae54025946ae77b012890ea7b92350 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:17:12 2024 +1100 Update gemma.py commit 97f378bcc0840c4d3a5c4b4e8d1978bfb526a253 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:10:35 2024 +1100 Update gemma.py commit cea0624e70ee610ffbd35104225a159e49f264ae Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:09:08 2024 +1100 rope commit 628e70cdd25d2dce88747667eba615fa43816099 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:07:29 2024 +1100 Update llama.py commit d694fef609557b0fdd4306925648b76b1ca4234e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:04:11 2024 +1100 Update llama.py commit a3d11b34dc1beb3373235417448d49c731d042f5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:02:59 2024 +1100 Update llama.py commit 63cadb3f9938788504f457a7d1df86def554a87e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 02:02:02 2024 +1100 Update llama.py commit 724b27f1d2829f6d68cf99b4a782c701de8e895a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:58:33 2024 +1100 Update gemma.py commit 5183602e8b2eb7c1027fb94b845d9fc30f98dadc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:50:42 2024 +1100 Update gemma.py commit f3065ea13835316ef22424d063071b1a25a41d5a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:49:39 2024 +1100 Update gemma.py commit 627937b1550729cd7adba100d89c71993afcfc7d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:48:02 2024 +1100 Update gemma.py commit 4d68150129130d63f925f11e7e8fa1862796d841 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:45:44 2024 +1100 Update gemma.py commit cee1ae3b2fb7a68dd0b123e8ce9dbc9ca350dd25 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:39:25 2024 +1100 Update cross_entropy_loss.py commit 08163047e301c0f7443cb5448db8aef05cdc8410 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:12:44 2024 +1100 Update gemma.py commit d46bfc6373d36ea8ec397e3b0b01856db51084b8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:10:12 2024 +1100 Update gemma.py commit 325c0b8d67b171f1843fdf38e93c2ed7dc60622b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:04:09 2024 +1100 Update gemma.py commit cee2da17eecc04a04e5320aa119aa9fc322fd247 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 01:03:04 2024 +1100 Update gemma.py commit f2286098a8919bd446b2dda3c029507633adb380 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 00:46:58 2024 +1100 Update gemma.py commit fb8c0ce45329da3c0dd822c9a13d5524e32d412e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 25 00:44:44 2024 +1100 Update gemma.py commit 3ace5c14f1e3f84b089848216005a492168f1727 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:43:00 2024 +1100 Update gemma.py commit 59a8f4831c20bbf0aa6228529edb0011be80e577 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:42:09 2024 +1100 Update gemma.py commit 62c4efe64cb54677fd76fec682916c926c815268 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:40:46 2024 +1100 Update gemma.py commit 13075821613eb6a0f88b5a8e13cea6fd027b9f22 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:39:28 2024 +1100 Update gemma.py commit 3988c185cdd1e7854a68c159249bcf54d679f951 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:30:14 2024 +1100 Update gemma.py commit 94b20233e307e94c94f4942707e29b0d7c14fbc0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 22:24:43 2024 +1100 Update llama.py commit 74796886617bb744b33b2e8e41b46fb4fa5fa1af Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:20:37 2024 +1100 Update gemma.py commit e2d9238541e54ab9ffbe5186864ed02c1121532f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:17:24 2024 +1100 Update gemma.py commit e10b39367ca079e17d82b19ed78ddffc523cb64e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:15:25 2024 +1100 Update gemma.py commit 8bda1a90140e3d3db6033b52ff2ca6f3e76c19ec Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:13:24 2024 +1100 Update gemma.py commit 27b61a859e6a6fad75b49cebe4d0ec430e5df32d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:11:23 2024 +1100 Update gemma.py commit 9b24b4136eb6123a699fb876e36be13329c33d7c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 20:04:31 2024 +1100 Update gemma.py commit 3a94184e912e5c3699ad54c25148cde451008627 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:55:22 2024 +1100 Update gemma.py commit f1120786772a4b7d566db51f9c03a1805b05182e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:47:10 2024 +1100 Update gemma.py commit 368ce5b7a1c90225c331b1587116b7b621d5a548 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:45:20 2024 +1100 Update gemma.py commit da3d8b358218ac344dd4598c1c621e0255f83c21 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:35:03 2024 +1100 Update gemma.py commit 65b33f53ae1d4773fe352e643be2b13d636ec4ac Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:33:04 2024 +1100 Update gemma.py commit 54e5b9225deb48c5c26567751a787d9eafaf8b7b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:12:52 2024 +1100 Update gemma.py commit 773fd0f171562bb58919d7d117b7f94218054a24 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 19:10:36 2024 +1100 Update gemma.py commit 5115a40e1a0111535fc87422112407eea3edd070 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 18:58:31 2024 +1100 Update gemma.py commit b025218e2f6bb151743269e61811d2f3003daa63 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 18:25:25 2024 +1100 revert commit 9f19c1625eff044e37f5cbe78685f79f0c22e652 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 18:17:38 2024 +1100 revert commit bf8c09dedfbbdd25ec11749e9f3af9e498b98522 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 18:04:40 2024 +1100 Update cross_entropy_loss.py commit 420016b0026b4abfc7a8f2c88c711734416c55cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 18:03:45 2024 +1100 Update cross_entropy_loss.py commit 85dc22cf17c885d067ea4a30062cc306baeeca97 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:48:19 2024 +1100 Update llama.py commit a92b3833f96665007fd088bf760cea8a604440b9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:43:19 2024 +1100 Update gemma.py commit 26ac9a9c03cdecba9e00b606c391a8cb81407a2e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:41:53 2024 +1100 Update gemma.py commit ec96f2e2c31c5d9fddf9b3726b7fc006be5b1575 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:40:21 2024 +1100 Update gemma.py commit d9dbbbbd297a5f6c60128c530cc70f4659d14826 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:32:04 2024 +1100 Update gemma.py commit a5bda1246b2f0dda7eec8c1839bfcbbed1870173 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:31:10 2024 +1100 Update gemma.py commit 4120727a81f3b6b3f9acbd40b4d662f13bee200a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:29:51 2024 +1100 Update gemma.py commit ba5e5aa5d9d97787507f39be66fe292cfca5b212 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:29:09 2024 +1100 Update gemma.py commit 60494835a1682294c1086260468729694ff4fbd1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:27:49 2024 +1100 Update llama.py commit 1c98acef382b0969d11b7f6668cfb5ce705c55a7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:26:19 2024 +1100 Update gemma.py commit 8741953d8e5d520e7252e660eec800f085691d78 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:18:09 2024 +1100 Update gemma.py commit 9c91cfa382f5ecde584cd3cbf46cdcaa45653cf1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:17:26 2024 +1100 Update gemma.py commit f6037c97a297c7920d19870948d1dfea6c2b939e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:15:44 2024 +1100 Update gemma.py commit 7b243e15f772428000fe8aafa57b7b8f50e6e82f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:13:40 2024 +1100 Update gemma.py commit c526f57f5ddbd1260d12f382bdc6178d9c7f9314 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:12:00 2024 +1100 Update gemma.py commit bba36c43c5458a988bcc3b13ab8815898c8b0dbf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:09:03 2024 +1100 Update gemma.py commit ddc66d7aaa959b5c78f4c26cc56beb9d4b84822e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:05:59 2024 +1100 Update cross_entropy_loss.py commit aa850a68a613e2527ef463825eb769c6ef7a0305 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:03:54 2024 +1100 Update gemma.py commit 0a93d5593b0d5fbf2008c7ff03e5a0fbcbc45f51 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:02:54 2024 +1100 Update gemma.py commit 921ae594f696691992e4fa42b41c4ce5c6da6687 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 17:02:14 2024 +1100 Update gemma.py commit 62d6ae0b5c0dd2881a521d2b2b9c86145082a35b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 16:59:24 2024 +1100 Update gemma.py commit 5bf985d36dc1d78ab8979fce2d1a384c628b37da Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 16:57:16 2024 +1100 Update gemma.py commit 3e01b97a85ee4896c61b1bf9e3f5b534a884a571 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 16:55:21 2024 +1100 Update gemma.py commit 2baac08445e365deb17ff23a01202ff779869ad3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 16:47:39 2024 +1100 Update gemma.py commit 7c5a30252e32144e27e3fa958c913aac92c6ce07 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 15:44:10 2024 +1100 Update gemma.py commit de7e30bebcc5ec4ef0ba62af54bd9061d18dab79 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 15:42:12 2024 +1100 Update llama.py commit 51e5098aa895047bbc9df72f7d0aa660ec87a037 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:29:15 2024 +1100 pos commit 5de9d3e8f641d96ba8e193528858935cd3b2a774 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:27:39 2024 +1100 Update gemma.py commit a029f97f2d25318410b75c3dd319dd61998b2d6b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:27:31 2024 +1100 Update gemma.py commit 13734913ce0741da634ee196a72556e78296846b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:13:31 2024 +1100 position_ids commit 068c6c885141c685a6ad33d4afb727c2b9e543a7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:06:48 2024 +1100 Update gemma.py commit 98c764c5a62117177d4c75fb23acc20cfde61c04 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:05:18 2024 +1100 Update gemma.py commit 4ee8732ccfaf840da607465551bde08db8dbafcc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 14:02:26 2024 +1100 norm commit a430c0c3496fe64d9170c64262dc683f59e51353 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 13:59:30 2024 +1100 Update llama.py commit 728f3421e9514c13e61fc9806a23c4e1d7cd1fa2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 13:55:37 2024 +1100 Update llama.py commit 5af7e82c9cae425ce37db70773e8b9d0c208e186 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 13:54:00 2024 +1100 revert commit 4bc30b2a6ac56b5d421d5ea17d9bb03a803f5afa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 13:33:05 2024 +1100 Update cross_entropy_loss.py commit 953ae0c39b2b8b6e2ce4364468b567b480cc48a2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 13:22:17 2024 +1100 Update geglu.py commit c89716a1f164ed579be10af285a98a689ab14091 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:40:56 2024 +1100 Update cross_entropy_loss.py commit 3d6b73e95852e1a5376ac22d3ee2af938bc23e80 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:40:43 2024 +1100 Update llama.py commit a8e7c3f15b6bf6bc9e81cb841c1bfccd9a50ad97 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:38:25 2024 +1100 Update llama.py commit 1489ac9aa7569a96cca8ba57d101db4cc3181513 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:33:46 2024 +1100 CE commit afea0cff1d428d3687af898da0f646300f799e55 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:30:43 2024 +1100 Update llama.py commit 4334bdacf75a257c94ed19b85341db6dd6bdc751 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:27:21 2024 +1100 Update llama.py commit 5bd0eb81ead6b24d1cef979920133bc136d6b0df Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:14:29 2024 +1100 Update llama.py commit 8763475b3713639b634e5a97e0999c95b08d6d25 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 03:03:00 2024 +1100 Update llama.py commit f275a96bd200016edcd31b454b4687ff08bd0378 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:58:05 2024 +1100 Update cross_entropy_loss.py commit 8b01731b3525a6eb29521f568f8f4d1a4357154b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:33:28 2024 +1100 Update cross_entropy_loss.py commit 12826fdb7186b88b9c6c5d84835182a8135008e1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:30:49 2024 +1100 Update cross_entropy_loss.py commit d47e7b6044850ebf58b23f39e5e8fe6902975cd5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:29:33 2024 +1100 Update cross_entropy_loss.py commit e4dc7a5fbf72243c048dc16f012cc1202d75cee4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:10:38 2024 +1100 Update cross_entropy_loss.py commit 3c923ec2b94e0f73d5adb4e617cdb7e5a1f27e4d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:08:26 2024 +1100 Update cross_entropy_loss.py commit 197988fb856a7afd3cacdaa36b929291040bf283 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:06:11 2024 +1100 Update cross_entropy_loss.py commit 635a075cd8610c427a1145eddb5a58079ea1035d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 24 02:02:11 2024 +1100 Fast CE Loss commit 3494c9c6a1ddc367d64b6586ac06afd0704db192 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 18:12:15 2024 +1100 Update fast_lora.py commit 41a7a4f50942498469fe0bcc23e9d4e56d9d99dc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 17:57:42 2024 +1100 Update fast_lora.py commit 26dff09c0ce9dda2125676aba25855ca54c91168 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 17:55:58 2024 +1100 Update llama.py commit a44bd045ae2eb8d14f5106ffd40eca23aceb0252 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 17:46:33 2024 +1100 Update llama.py commit 6e88a7028f1afcf788f8a208263e88c834313583 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 17:37:17 2024 +1100 Update llama.py commit e1bbc946a095a249650464cba99b29368aa446de Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 17:28:29 2024 +1100 Update llama.py commit d9ebedf0e26502a948e9c8d240bf7ab338a2a093 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 04:11:08 2024 +1100 gemma commit 67b573f33c30bdc114e91c636541a492b8f0fc99 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 03:59:09 2024 +1100 Update llama.py commit 8c26059f384a93830e81a9ca29d834c5a748795d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 03:52:24 2024 +1100 Update llama.py commit ed2169f5d511be91da70438e6704c3eabadcca4e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 03:27:42 2024 +1100 Update cross_entropy_loss.py commit 8ae7978c672410908e24874cd249110b80c51407 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 03:27:03 2024 +1100 Update llama.py commit 00caade150af8ef750d7cb80bb83b8fadba15a8c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 03:16:50 2024 +1100 Update llama.py commit c009900ead6cdac80b15622d0829c2774afeb4f3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:38:16 2024 +1100 Update fast_lora.py commit 29f0b1a3b6e60a1eb418029d403aaa164ecc30d1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:33:37 2024 +1100 Update llama.py commit 82ce8d6d1fe1200f471ae22c4568b8ea7219be17 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:28:05 2024 +1100 Update llama.py commit df59715b4a22575ab062d68bd8a820fd995ea39a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:23:25 2024 +1100 Update gemma.py commit 07fd51a2b57636e5d540feac264ffcd3358be644 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:20:26 2024 +1100 Update gemma.py commit d5a315026d71e0ff892704888e4eefa50b7b5af6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:19:06 2024 +1100 Update gemma.py commit b8f5682a3122cf28d2dac091dc8bbff4d5a9d50a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:15:12 2024 +1100 Update llama.py commit 6cd4aea75397ed0d8144348f04ea670fb099052b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:12:02 2024 +1100 Update llama.py commit 25ff38244e2eae5baf50006b9fa01b337b7bd56d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:10:11 2024 +1100 model_type commit a3c46fdd5c73f1ec4d1fdbe7871f158e2dcf8d09 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:05:31 2024 +1100 FastGemmaModel commit 4c7de1c8b6bbe95b7e1bbd5e8b85c57965d22dc1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 02:02:39 2024 +1100 Update fast_lora.py commit f0847548d94ae74806ca6716632626a43b51aae0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 01:57:34 2024 +1100 Update mapper.py commit 8adc4183173cb9466c3a828947c816ff65c6fd00 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 01:55:25 2024 +1100 Update pyproject.toml commit 848af110f8c54cecf6217728251ae9dedac93ba0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 23 01:50:51 2024 +1100 Gemma commit 043522e4a8aeb0600b78edbbc9f0d40c16970d17 Merge: 55463ec `5667edb` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 17:49:57 2024 +1100 Merge branch 'main' into nightly commit 55463ec69d712de94c33dc86af15391f189ac210 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 03:29:49 2024 +1100 original commit 7178af93358e3f6b3e134e366671f63eeaf2accc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 03:25:46 2024 +1100 spaces commit fccf8acef11f090859c89fa3e8a404cedd14e736 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 03:14:27 2024 +1100 trainer commit c9a94cc35519835bd9eaf4eafe3acc9bb9e1557f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 02:05:33 2024 +1100 save commit 64ba99e3dd0540acd434a873717ba8d3cfe7c79d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 00:53:17 2024 +1100 Update save.py commit 952f7d2f7e1ec20cd552312de9a193c24b507d13 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 21 00:48:18 2024 +1100 Update save.py commit a1476dec53826de8cc2e7faef6f7c79e67be753c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 23:28:37 2024 +1100 Update save.py commit e19031f84c6ed54ff689e2afa01340aa59c7841f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 20:01:33 2024 +1100 Update __init__.py commit 557ab79c5d2ba4435bce00b7d1c6fc038d922c4c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 19:50:29 2024 +1100 Update save.py commit c33b1b7bef137fda5929263a96d304524e42e844 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 18:35:11 2024 +1100 Update save.py commit 176e78c57216c5c88c4a5090fb05db7fb2de04f2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 18:00:51 2024 +1100 Update save.py commit a2c683d2ee7c995ec5ae64c404987bd05b198ac1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 17:12:18 2024 +1100 Update save.py commit 4c26616cfa91c0fef7f50eb51182afbbbdd91fcf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 17:11:33 2024 +1100 Update save.py commit 46e4e29d4a077b564378087d39351484e216e66e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 17:00:19 2024 +1100 Update save.py commit 6db70b20752912e68d6bc40c937f3e7dc55c0b83 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 15:59:38 2024 +1100 Update save.py commit 989da54c6b0a2dfbb1a3166a3e8f7a31ef306ce8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:44:17 2024 +1100 Update save.py commit 79deb30d27c2f3f64c3e6cd39c0884ce317605af Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:42:47 2024 +1100 Update save.py commit 93bba6ae17be9b02c2382af3a9c5bcfc3fb1b50b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:41:40 2024 +1100 Update save.py commit 651ac1ea9539028dfb42b7887ff9498b4ec53475 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:41:34 2024 +1100 Update save.py commit 62005dfd19661441783edb33f6294074bfe8c687 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:35:07 2024 +1100 Update save.py commit eba070b4208e5c30b8bc3485dbc42a7f3a190fe8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 04:13:58 2024 +1100 Update save.py commit f13c8ac17627c2151b5ff9257308ce16e73bf89d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 03:35:19 2024 +1100 saving commit 41da9825ac36f8f8db3ecb27f3d4e3ff2662a521 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 02:19:36 2024 +1100 Update save.py commit e69f52fa57a6216fdacdc449a97267f70c99be59 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 02:07:01 2024 +1100 Update save.py commit 122a0d83226aad48d5cb18853f392522e3d3137c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 20 00:10:04 2024 +1100 llama.cpp bugs commit 703c954c310f3878c1502066d456af4b40fee75b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 19:39:47 2024 +1100 linking commit b7e9debe21a6dbb132b0db1ac7a14a1d2c4907af Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 13:08:03 2024 +1100 Update save.py commit 7be8a1fcf503914ffbb0189f0a1e30e2ac2fa3c3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 12:51:25 2024 +1100 Update save.py commit 19837f91ebba07cda714fb174271998814bf313b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 04:13:40 2024 +1100 Update save.py commit 77c150d3c21df963fd70fcfb9c57bf69a3dc4087 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 04:01:27 2024 +1100 Update save.py commit 7108f839edd431b592dafae4a8fe7ecf792cae1a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 03:39:09 2024 +1100 Update save.py commit 38e2516884ee1e856f3f46db7c28f6ca4ad421fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 03:22:21 2024 +1100 PeftModel token + saving commit d8a371984876b842febd555127867949b6f032c4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 02:45:54 2024 +1100 Update save.py commit 8866e5736cfcfb91dc97c2844ac2f4e2dd8e828e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 19 02:37:43 2024 +1100 Update save.py commit 229baae1df7110889b6d2a7f895fa2f7b2c4af2a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 23:35:18 2024 +1100 Update save.py commit 1973ea9585d13ce0bb2e0476e3442e0bee901dac Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 23:31:24 2024 +1100 Update save.py commit dfdc0b161a3eaee73c13d924a6ac87df0f2a2a3a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 23:25:36 2024 +1100 install commit 03b9843101d87994df3a1cf9e4d70d88b9f0ef82 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 23:12:37 2024 +1100 Update pyproject.toml commit bf376857c6bc7e410e0d9c61853a1d195742f5a2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 22:59:37 2024 +1100 Update save.py commit b9bd64f81b3e915f788b776b23a50223a10b5dff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 22:54:38 2024 +1100 trainer commit 1c192c9afe36fae3ae9be93ce58b34ca90472ee3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 22:52:51 2024 +1100 Update save.py commit 4809e434beede5e7aa166ad3efff192c5eb222e1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 22:03:22 2024 +1100 Update save.py commit 65f6c673837e51109a5296c5983fe84bd1265625 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 20:28:56 2024 +1100 Update save.py commit de374677f59060849b1545e878dd24a3c569e0f7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 20:22:52 2024 +1100 Update save.py commit a6e2013a7d32b3e5c3adaa8180477728332acc94 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 20:19:28 2024 +1100 Update save.py commit b59b3e51ef825e2bb6f329c73f3a198d594b892a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 20:11:51 2024 +1100 Update save.py commit d552bdd521c23f7969764da58f53dd59ea3ffcf1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 20:09:11 2024 +1100 Update loader.py commit 398604fca1ff5c0f5f3307e95cf87adecf24715b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:54:34 2024 +1100 Update save.py commit 2cd3b8b7dffd68e108706acfe5c00f5abafc327e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:44:59 2024 +1100 Update save.py commit a69c2060e0e9f777c74de73f991103051f113e53 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:25:56 2024 +1100 apache commit 5609a8bee9e2783aa108d34346616b98bad5ab6e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:24:35 2024 +1100 spaces commit 84354dfe6a29c2ecbbe2baff585bcdf1134ab968 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:21:02 2024 +1100 slashes commit 2cf8501db39756c545aea1d8978fb77c38fa5004 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:15:41 2024 +1100 slash commit 66fe8af9b46d5ba372ebd600c85635d07425a2b0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 19:08:04 2024 +1100 globals commit 88e9bdf47601e974cb115165f20189da51891d5a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 18:30:03 2024 +1100 spaces commit 744553d1fd271cc9f513915564d5929d5b1addcb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 18:25:19 2024 +1100 spaces commit 112120b3611e8302168f4697aaa409c6f2c68da1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 18:21:54 2024 +1100 readme commit 7b971c3e0643b0a2374e0be4c4e6e7553c64f61f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 18:18:12 2024 +1100 Update llama.py commit 8b5e818712336d524e831bc1b82781f5164405d0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 18:09:38 2024 +1100 saving bugs commit 40116315c4916c5f9f00464e3efbf44eff018009 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 18 04:15:20 2024 +1100 Bugs commit 3c6140fbfb2c886bf2a6aa5f9ac8293390b0a805 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 15 19:24:07 2024 +1100 Fix RoPE precision issues commit c1cf8b75157d955edb558e06d32bb218e1d48bf8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 15 03:53:58 2024 +1100 Update mapper.py commit 846f5b22740a9a4c2b762a321dd607881ed6fa65 Merge: 0391a0b `d52ab5c` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 15 03:35:47 2024 +1100 Merge branch 'main' into nightly commit 0391a0b099aff978c29c3e6d86b8e013ab572d48 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 23:17:38 2024 +1100 Update mistral.py commit 454b93de371963d9f464e6a4133213fe17671ca9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 23:15:45 2024 +1100 Update llama.py commit d29f2b0301efa54a9f592b9f8fdc6f89e0eec375 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 23:11:06 2024 +1100 Saving, LlamaRotaryEmbedding issues commit b5b142ddf63a6461019d9ddfc86a424d077a3d8f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 17:58:41 2024 +1100 Update chat_templates.py commit 90a40f4886249658a6ffbd716ccf4fd2e68e49b7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 17:56:14 2024 +1100 patch tokenizer commit 96d8f5105394f729090f55e5382727bb48c73e5e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 17:45:02 2024 +1100 Update chat_templates.py commit ba40db55bceda0bb47bfb61b799f29668a532178 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 17:31:33 2024 +1100 Update chat_templates.py commit b764d042b9ed441b66ef6d0c572e98b4980cefe6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 17:27:03 2024 +1100 Update chat_templates.py commit 1a0a1ae4940f27bc2f12f8dfdd2c8cc0a3269a3f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 04:20:41 2024 +1100 Update chat_templates.py commit eb3c22a40714772896c83993f99f4d8197bc75ca Merge: 26e3789 `077e9dc` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 14 03:25:40 2024 +1100 Merge branch 'main' into nightly commit 26e3789e3f38e0354cf28525d178dcc4c2753f99 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 12 04:28:41 2024 +1100 Chat Templates commit 7709bb06c57e1a64f97186763aa137164968f243 Merge: c51bcca `1191e83` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 11 16:42:37 2024 +1100 Merge branch 'main' into nightly commit c51bccac7b1cb99a46512a7d974e642a24f31514 Merge: 8a2b722 `032702d` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 9 03:52:36 2024 +1100 Merge branch 'main' into nightly commit 8a2b72207b38239c2a98f313085ca35b6dca5a00 Merge: befb024 `e37814f` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 16:50:19 2024 +1100 Merge branch 'main' into nightly commit befb0249dc4bebf85b2a3f541bad17d7f7feab9d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 03:39:45 2024 +1100 Update llama.py commit e95d736ca0103728958d526d91a8104889c08045 Merge: b675872 `522e368` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 03:39:19 2024 +1100 revert commit b6758720e34876c8a0e9cdeabe07ad1c7d96e373 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 03:00:53 2024 +1100 Update llama.py commit 194a1123f71cb2e6376e5a45d2561625410cdbdd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 02:57:09 2024 +1100 Update llama.py commit 49e361e9a40e11082e03d783d4d12aa82c0db842 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 02:52:43 2024 +1100 Update llama.py commit 22bef3a3622008f0c2730593271e0c062509c37b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 02:49:26 2024 +1100 Update llama.py commit b76f7973e5fffefdc6a48313bc2d05bc5d2399ec Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 8 02:30:49 2024 +1100 Update llama.py commit 98365cfdf1f65f09860a161e62520b2866d740f1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 20:15:19 2024 +1100 Update llama.py commit 6fe5cfc71cccfb44333df02444dc5f5cb6d6e429 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 19:25:46 2024 +1100 Update llama.py commit 34ce02efba12c0d2bf7712d8a2498135471da323 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 18:25:08 2024 +1100 Update llama.py commit 7c58754c5336c252e1f764d19d07e43af358c0c6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 18:21:36 2024 +1100 Update llama.py commit 59a202961f96fec8760318ac05e771fb1fcf4906 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 18:18:43 2024 +1100 Update llama.py commit e0ab7c78c4645418542b9164beede9a83c9ba6aa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 18:02:58 2024 +1100 Update llama.py commit 6ce38954663a8bdc725206d3b36bdfffcf316580 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 17:43:51 2024 +1100 Update llama.py commit e4231c5e47e560584857fecb8dd42b1e1823dcb6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 17:34:59 2024 +1100 Update llama.py commit 52cd25fb6fe7312668469bbfddd5ee9efcbc9a78 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 04:40:19 2024 +1100 Update mistral.py commit 9f0288aabac2c482c73f3c9990e39dbbdaece1af Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 03:45:07 2024 +1100 Update save.py commit 2bf7a9b60229b5bdbe034fe56ff837e48ee968f6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 03:41:32 2024 +1100 Update save.py commit c94039f291af129d2e3153baa3ac0dfb1fd6397e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 03:20:55 2024 +1100 __version__ commit f4fe580b5cdc60c96e089d614743b214864395b5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 03:19:33 2024 +1100 __version__ commit 6745edb5df015bfc4c6a251a87b43abc4a11453b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 03:18:02 2024 +1100 Update pyproject.toml commit ed839d3cb30fd7f2e5c683812f9adafdfcbcd006 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 02:57:54 2024 +1100 Update save.py commit f46757d0b2338215ec1729619ad4605659f1ea42 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 02:57:24 2024 +1100 Update save.py commit 24d794990256015f2dc1eb9bd8523b1af737b619 Merge: 6235c6e `ccbf2e2` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 02:50:35 2024 +1100 Merge branch 'main' into nightly commit 6235c6e8c2be45699b118728379ede32edeb007e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Feb 7 01:48:31 2024 +1100 SWA inference commit 4d8198f240b75c009af6ab6aa14a3605909cbde4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 6 18:53:32 2024 +1100 Fix llm_int8_skip_modules commit 468b8f24f3d184bee98cec2401aa39bf9b67a49c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 6 18:50:48 2024 +1100 Fix SWA inference commit d9753b80a1bbae67c5048e42cbbd396d51cecc3d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 6 02:11:06 2024 +1100 Update save.py commit 4f8bd076efcce1ef7dc589fd26635ba7165040cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 6 01:54:22 2024 +1100 Update save.py commit 10f9bcabc60afb507839e0409ae1b5a20ac6d855 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Feb 6 01:30:48 2024 +1100 Update save.py commit db6df6b0257d90a62b1bcd5836a6648eedb33b10 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 19:07:00 2024 +1100 Update save.py commit ffa3ae00bd20799721e687e37430f6d62c832057 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 18:53:27 2024 +1100 Update save.py commit 71e9292c9dde6f2bb37f9331aa4e27f7a47e3f7d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 18:48:40 2024 +1100 mistral swa commit b039ec33d6aaa00b22f52a194c7a71ec74e6863f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 18:05:25 2024 +1100 Update save.py commit 0e38e54180db1831e50d3027ad074dae7b818828 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 17:38:01 2024 +1100 Torch 2.2.0 commit 561c9cfec90e8e3b4bd8cf05fb25279ec77d89d8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 17:32:43 2024 +1100 Update save.py commit 50744cec60a0e3baf334d3872a98b94b1ef74218 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 17:16:20 2024 +1100 Update save.py commit 38ca90cf986795b6b0c62c1a80e07e6d0bf7aeef Merge: f7eb58e `3291181` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Feb 5 02:29:56 2024 +1100 Merge branch 'main' into nightly commit f7eb58e38ee1a131c17a8aeb7594bbe8e2c89113 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 14:02:26 2024 +1100 Update utils.py commit 805cbc0401fa5b8546596ada12d73a6aa6c7a72e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 13:50:21 2024 +1100 Update utils.py commit 72f1949cfcc3c5e13caf5abcd58e30a922d5eefa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 04:07:47 2024 +1100 Update llama.py commit ab29a1c727c3d7672032d3d49abb4042cf55c8cb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:57:29 2024 +1100 Update llama.py commit bf997c9b6534da3884e68ebe65d6213901741a36 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:54:12 2024 +1100 Update llama.py commit 257b3ebc07ff3d5594ef9bc14565085e142b4301 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:52:08 2024 +1100 Update llama.py commit c25ac7e156b57b8c39b472032dd9333986e11755 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:50:31 2024 +1100 Update llama.py commit 5d254367fe6f92d8845d2f443332410894dd61e3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:48:18 2024 +1100 Update llama.py commit 8280b51942af65b452efcfdccfae1a06fae8bbde Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:46:30 2024 +1100 Update llama.py commit 82eb2e92e2cedea8ec2f020fc7fc252ef4aaa03a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:45:25 2024 +1100 Update llama.py commit 88605453ffe3f885434404ec6a2edf5fb2888378 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:42:41 2024 +1100 Update llama.py commit 1795f0c03acade64ce7b4601554321bdc5ff43fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:41:15 2024 +1100 Update llama.py commit 939d2a1f934876097a9bde3991a61928663210d4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:27:15 2024 +1100 Update llama.py commit 4ee3006f2dcdbb10e57f40b9134ad4df47fb4092 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:23:26 2024 +1100 Update llama.py commit d9adf92a77aba94de8a31eb7caf7ae2338dfb78d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:13:42 2024 +1100 Update llama.py commit ba5d2f0190dc9d9f07418d4a30a44bcef87abbea Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:12:07 2024 +1100 Update llama.py commit 898aa32313b8258670f2a4b07a55ab438eb421b0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:08:49 2024 +1100 Update llama.py commit d207a900ddcc729446cc878949452c5749826b91 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 03:05:49 2024 +1100 Update llama.py commit 1fd3a6a8d000385c0c605b1be0fbcc745831214e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:49:51 2024 +1100 Update llama.py commit f793e74e221a7462e1bfffbefbc43e931e53a8cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:42:30 2024 +1100 Update llama.py commit 7845e206f1b17e98732ba7ddce72fe3a2dea0406 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:40:30 2024 +1100 Update llama.py commit c2fe7c2a9b45c6f6a35bd7cb7b29d3659006ee76 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:35:17 2024 +1100 Update llama.py commit c532ba0a8dca36359c6d13422b4994f63109f281 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:32:21 2024 +1100 New version commit 0cddc0e836a6990331e892271bfe76ffa8069e2b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:19:42 2024 +1100 attention_mask commit 89cc2487c696cdb6258f62028acee5e8bbf23f95 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:03:23 2024 +1100 SDPA commit 2b15602ad9e5275beb819232032ff5bbacdc510c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 02:02:51 2024 +1100 Update llama.py commit 34b4ad6ee5ada6a3653ae31d044c9a36a2cef0f8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 01:46:04 2024 +1100 Update mistral.py commit c6dd3a0e7f38737dfe10861696ed11990b1b9b75 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Feb 4 01:42:46 2024 +1100 fast inference commit 5fa63389102b7d43fc642178791fa1117a91e3d8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 23:22:21 2024 +1100 Update llama.py commit df1c91f1a6190844f8aa48894a9a436bb9b71dbb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 23:12:16 2024 +1100 Update llama.py commit b23ca9168deb443534104f3c368bbcdf7f31989f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 23:01:56 2024 +1100 Update llama.py commit 9d08fd5a0db03515255a262ae6a90d7621a1abf7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 22:42:11 2024 +1100 Update llama.py commit 1d308dbcd1afa460c164ac8e2274edddcd7e5d7c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 22:28:20 2024 +1100 Update llama.py commit f536e937e574fb0531a7de9eb1a26d9869ef2797 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 20:22:42 2024 +1100 more temp matrices commit 5899bf4b4efe0bddbf0e907263a94607cb90af01 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 19:44:36 2024 +1100 fast inference again commit 990a9f12f09779cc605ee24c4a01b22a402c5d83 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 19:30:22 2024 +1100 Update mistral.py commit 49105333a3d5e8474d97926694d57b8b04afbaff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 19:19:13 2024 +1100 Update llama.py commit a88b6c4d63abeba0995719108b2223980a7530ea Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 19:08:42 2024 +1100 Update llama.py commit 58665698c40af8750c822367d2e97e5f9dfa904f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 18:32:18 2024 +1100 Update llama.py commit 67d7d96b3812f87d81c50001cdc4dcd710006a93 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 18:20:06 2024 +1100 Update llama.py commit e58d17dbe928854aedb8ea4992d3226ea977c11c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 18:07:55 2024 +1100 Update llama.py commit bc9f14ec18ca74edfdfeb429dbaaedeae17fc834 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 03:52:25 2024 +1100 fast inference + saving config.json commit f2c666e452d83ce2e9e01b6a19ac1f7d1302b57b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 03:34:02 2024 +1100 Update llama.py commit e14f3ffba785618eb7ca42159de99761f9d9bade Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 03:10:39 2024 +1100 Update utils.py commit ec5dc95472de60f20ee639b806e6ac9d1fd34a80 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 02:55:22 2024 +1100 Update utils.py commit 013987e61e1be6473a9098df2ad12885c09f7f7c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 02:30:47 2024 +1100 Update utils.py commit c59f2398812417426a69fd1ec39d08b725813bca Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 02:20:00 2024 +1100 Update utils.py commit dc13df5c951eac5ba5047b5cc32bbb5833493713 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:50:48 2024 +1100 Update llama.py commit 8cf454cca606c8129fbfec2ffab3fbc7d8e1ae40 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:48:03 2024 +1100 Update llama.py commit b3fbb2482f28cd05d083932bb9406d43b424aba3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:39:39 2024 +1100 Update llama.py commit 2876f4827b7922f1a96ab54b83f0b7a31e76dd51 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:35:45 2024 +1100 Update llama.py commit f11b986733eec0081cba8fc55ee846654a21c160 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:29:50 2024 +1100 Update llama.py commit 092e400d1bffcfbb95cdfff4a29815d3c05979dd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Feb 3 01:22:53 2024 +1100 Update llama.py commit cb6eb13ad0903f73c850d974d4b9d842bb9eae50 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 23:45:02 2024 +1100 Update llama.py commit e5a94a5c3b2541679d86b19d460fecd1ab972fd4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 23:40:52 2024 +1100 Update llama.py commit 441c7f88a866027d322f9d02dacebb5e1241c777 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 23:32:58 2024 +1100 Update llama.py commit 0aad85d18b1f4bddb653bbb719d2a9279812e72f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 23:32:36 2024 +1100 Update llama.py commit ca458996cffaaf094d608c1c3bbd33a1030e0ede Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 22:26:47 2024 +1100 Update llama.py commit 1af54271148b3b2efc38a3006420285faac57cee Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 22:22:42 2024 +1100 Update llama.py commit 64e4d6bf274002117ee8db89af4ccb1ac8f7609b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 22:20:45 2024 +1100 Update llama.py commit e0bfd4b43e59d75962f4dfd52e94b634b0023cff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 22:17:02 2024 +1100 Update llama.py commit c4df0544b4383ae5fe0f249740d22d9be936d44e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:35:00 2024 +1100 Update llama.py commit b179a5f81caa729f32f0e6314ebfefb48d530cf4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:32:21 2024 +1100 past_key_values commit e7f07e808b0d28c6de83e4f339588ef7859f9a96 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:29:35 2024 +1100 torch compile commit c91ea153de102521afa2636f1af35ff43a4dda4d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:24:44 2024 +1100 Update llama.py commit e718936afd8237670eb780566d1110b1f50dfe8d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:24:28 2024 +1100 Update llama.py commit f063cf5c2faf3498a5fdee3a64e4e4b5855c58a8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:20:14 2024 +1100 Update llama.py commit 8f8149d3bb21942c113d8c8c2f5afb0d1799a88f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:19:15 2024 +1100 Update llama.py commit 4764ce24707179b4780ea78c68bfa4b638c61f4f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:06:52 2024 +1100 Update mistral.py commit 947ebad95b422fd833e9afe1c51024026cb875a0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 20:06:31 2024 +1100 Update llama.py commit 6796488f37394801cf7302b3a3126fed2fb735d0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 19:44:52 2024 +1100 Update llama.py commit cf79a4a84bb4789fc5de9587bc1bcafb2350cc34 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 19:07:41 2024 +1100 fast inference commit a851589ad5d7fc7110bc69e067a1ee0cb50cc9cd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 18:28:05 2024 +1100 Update llama.py commit 0cc8387a2864be2b06b6a3b9a1feeff990da7acd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 18:14:31 2024 +1100 faster inference commit 66a0e5ae5b14ac2a6e6cb37d7acedf61be141860 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 16:59:02 2024 +1100 Update llama.py commit 11197b6a238e98348e86f06ae5b1f4b7516f614c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 16:46:30 2024 +1100 Update mistral.py commit a633ef0fa9ea06c630211544db79aba0b2f14c0d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 15:56:56 2024 +1100 Update llama.py commit f2421dd081bca7119d2d76ad66fecec8f30728a1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 13:52:12 2024 +1100 Update llama.py commit 497f6ecfc39398a0c41568e5b685818af422e233 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 04:18:34 2024 +1100 Update llama.py commit 47f8cac9344f310bb9bed1719ec17123669e793c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Feb 2 03:55:36 2024 +1100 Update llama.py commit fdb86910e7e98cb69adb2df82d0d3f4044681e24 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:54:01 2024 +1100 Update llama.py commit ef6762c26259e6f951ecbcdfd909deb152a730c7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:41:32 2024 +1100 Update llama.py commit 66d580b1ebeae4daa5101d7f04494cdc59190040 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:41:23 2024 +1100 Update llama.py commit 60cdb3e276f63cc2e951d818b82509c3913b00e5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:41:11 2024 +1100 Update llama.py commit a916575fa3c071c378ad11445e55b13221b36228 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:40:36 2024 +1100 Update llama.py commit 04a3b51343baaefe344ba35961b0f80f77671056 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:38:07 2024 +1100 Update llama.py commit 742ad42a90b93b07aebc19f8303ab408d29ebbcc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 23:17:53 2024 +1100 inference commit 92bda795e10afe27dc41d357a218743ce89d40a8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 22:48:54 2024 +1100 Update llama.py commit a8e2b790fe31252521785b4fa6180d0f44014b8f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 22:34:33 2024 +1100 lm_head commit 927b19b8d32f59e6c920ab48a88b05d84bfe4c43 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 22:21:35 2024 +1100 revert commit eb196721eee38ab2000b362c168f40b6fa92e920 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 20:12:59 2024 +1100 Update llama.py commit d74d5c80c5d7e386526ab1eadf34e1ce3e00cb70 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 20:03:54 2024 +1100 faster inference commit 5891311c96b1be2d1f0d2986823939abf8111de4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:56:54 2024 +1100 Update utils.py commit 20cda2706417be6f9b1c65046377002e3086cb1b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:56:06 2024 +1100 Update llama.py commit e57e79313ee2fcc036f005ca52557b9561882199 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:46:38 2024 +1100 inference commit 74085092391532901262275d91585c091222d35f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:36:36 2024 +1100 Update llama.py commit 9da0b7b35d2d96d232257f15e798ce5151e493b1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:19:44 2024 +1100 Update llama.py commit bf6f18bf5ef7188df9b260db6e9bcce39979fadf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 19:07:30 2024 +1100 Update llama.py commit 558b5891b9d3a55a9437ec4a66b4997a7560ef07 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 18:34:43 2024 +1100 Update llama.py commit 5fc0de376b28df497bdde7d1b20e6d3962550e24 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 18:16:46 2024 +1100 Update llama.py commit 13a8caba41694edd22afce35563517834b0e1ed3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 18:16:15 2024 +1100 Update llama.py commit fd38079f7b5448c1071fc2893f657da603f9e7bc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 17:59:21 2024 +1100 Update llama.py commit 6c9e8a1bce82c38bf5b3898df70ed9d2ccbfa199 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 17:44:22 2024 +1100 Update llama.py commit c54101cc38a13f840aafe1a11fcd5b06a2e5e2ec Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 17:20:02 2024 +1100 inference commit aebd82d9dcddc776ea54e44d8e9899b7698d38f9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 03:47:51 2024 +1100 faster inference commit 6638adf0b940bd244128dfab627af741dd76ba73 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 03:05:02 2024 +1100 Update mistral.py commit 9b235ae218638dee7d1278b320de59c7b335b369 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 03:04:46 2024 +1100 Revert commit 863677f9b4e144d6979d5ddc78e57e59377d44c9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 02:47:57 2024 +1100 Update llama.py commit f700d765acc00622edbe9ea65115b1d8b81e3c1a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Feb 1 02:46:26 2024 +1100 Inference commit 42502baa3089e873dc77b11ea0b0c7bd97baa2a2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 20:16:08 2024 +1100 padding commit 797679ba534c31bed70fc7c71659e4869e0bb0d6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 20:06:28 2024 +1100 Update llama.py commit 185407e4cf990a9bb5c62912b032e7db7b897e49 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 20:02:21 2024 +1100 Fix SDPA commit 47e2721e185bcd3fc69d64c9cfedc7bd7e5469ee Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 19:48:33 2024 +1100 Update llama.py commit fedbfc235e1101c63c00914f9cc7e8aaeac6d6e6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 19:44:19 2024 +1100 Update llama.py commit 8a1ac5bb8e37f1215254883498b4eb326c8ccbd0 Merge: d172c0e `d34236d` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 19:38:27 2024 +1100 Merge branch 'main' into nightly commit d172c0e2a155d71870b6cbdc72c7373a12e814a9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:50:47 2024 +1100 past_key_value commit d338a0a9358597d7b225a8427ae66972aea7c12c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:46:11 2024 +1100 Update loader.py commit f3d3d9efa55bfa37ffb89c01bdcb80120660e34a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:40:55 2024 +1100 revert inference commit 11aa14ff3274f91b39e6ce1362a64ed47763c0b9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:36:40 2024 +1100 if past_key_value is not None and q_len == 1: commit e3cbe7dc7d460021dd95e27f82e6711f72152f7d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:35:24 2024 +1100 LlamaAttention_fast_forward_inference commit 35fd2b14717281a20f219a3c8e12d60ee8abb8d7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 03:28:30 2024 +1100 Update loader.py commit 7d86380ddfc74140d7536563d8b46faaa0dc723f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Wed Jan 31 01:32:56 2024 +1100 Update rope_embedding.py commit 04c072b67fe1577d0b75f3481dd6f883520f2198 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 17:33:08 2024 +1100 Remove fast path commit 9440ba4a2a82c7bc63845a02aad2b260fa53ae7e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 17:26:45 2024 +1100 fast lm_head commit a8467a66a41fc82515807e155f787146eb5d82ea Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 04:16:39 2024 +1100 Update mistral.py commit 98d436235cf250e3af9e028205d24ac9c809268a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 04:10:14 2024 +1100 Fix inference commit ca6318b0beb0268120ed32566aec1308ff4c376e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 03:23:42 2024 +1100 Update __init__.py commit c53bb3c5f5ac9285a6a79f59a14d3d5c93354376 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 30 03:08:46 2024 +1100 Update mistral.py commit 353cfb85c8e86f15c6c73f434e40c632d41b7782 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 23:19:43 2024 +1100 Update utils.py commit 26a5d5371a6d6a267afbb6730d01ad06642f048c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 23:14:51 2024 +1100 Update utils.py commit b354b74bf2fb81926ecb1f8752a738e349a5b1fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 23:07:40 2024 +1100 Update utils.py commit 6901a872f1cdd42568bc4d1a59c94c0d2583640e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 20:09:59 2024 +1100 Update llama.py commit 9de0d4672edf917f7b2cdf85c04cb9304a27a4b6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 19:55:40 2024 +1100 Fast inference repatch commit 84f1e5d734757f510b51e571992946c6171521bf Merge: 8eaa969 `3ae04d7` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 17:59:34 2024 +1100 Merge branch 'main' into nightly commit 8eaa96946a136ca1e25dae48081e23caeb1daf49 Merge: 91e3e8f `2383d04` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 17:49:57 2024 +1100 Merge branch 'main' into nightly commit 91e3e8f4a6faa45bd7711b46683de951ba8c38e3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 17:35:19 2024 +1100 Update llama.py commit 734a75755946da575dedf731e7afc8c056436d8a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 16:52:04 2024 +1100 Update llama.py commit 25a77cfa4655e8ef58a624a17a11847cdc4730fb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 03:43:39 2024 +1100 saving commit 5d3b3da8458b9d2913ad813c2c7ded1a80ee146c Merge: cea551a `17e07cc` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 03:43:19 2024 +1100 Merge branch 'main' into nightly commit cea551add7f7c9fb0fb98470ca1957e7d496352e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 03:43:17 2024 +1100 Update save.py commit 85c1f75d65d0bbfe087f1cb2a9d0804b11a4a679 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 03:43:05 2024 +1100 Update mistral.py commit 95998df31c1904a58e4d8516f64fefa17c294b49 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 03:34:27 2024 +1100 Mistral patch commit d388a1a36f13dfc14f5a5f5334fd558802ff88bd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 02:42:08 2024 +1100 print commit 04f006c442eb79602a99ef73013d84e9fe7b7181 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 02:15:52 2024 +1100 Update save.py commit 0f23dc7fb6c2d2cc343becf7aafe9d4eab7ff414 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:59:29 2024 +1100 Update save.py commit 03e989652d13df396cded2271ab54d81aa979afc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:57:11 2024 +1100 Update save.py commit 63526c173621fb561f829eda7ed3b0a51364b4fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:56:44 2024 +1100 Update save.py commit a559d1cd1ba19ada3c6cbeb7c86d7af05bc14873 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:51:57 2024 +1100 Update save.py commit abb4c0de50a5b40fc450fb4c9a10c645390c9164 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:51:45 2024 +1100 Update save.py commit 66712f549f370122af080898833a756008a5f2c8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 29 00:49:31 2024 +1100 Update save.py commit c43df4a0ba5f0423fa567b9bfecff78da0896ecf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 20:07:17 2024 +1100 Update save.py commit e431b26bf3bf5f2bdda2b76350620c5c141b8ca0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 18:12:11 2024 +1100 patch_saving_functions commit 56ee902f4b4933460408f13264af83e58066e948 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 18:08:52 2024 +1100 Update save.py commit f9e8da848e82f399fa8446358537cf417a22dced Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 18:04:35 2024 +1100 Update save.py commit c0dc13de8f12b8825dc8540df0fbba9be94ba4b4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 17:48:34 2024 +1100 Patch saving commit db0ab44987e0715256df99dc40d44ffe8d12d9e1 Merge: a289969 `b4b50c8` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 17:48:28 2024 +1100 Merge branch 'main' into nightly commit a2899696cdcabd240279f97f2370d22a6f62b89d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 17:20:49 2024 +1100 Update dpo.py commit 53ce323307fbb93c61dd8ae2234d6da2846a9d5a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 16:47:33 2024 +1100 Update llama.py commit d2d8946b0a3112866d8a647c5b9a526f9c61e017 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 16:43:10 2024 +1100 Update llama.py commit 507c505ec16f9865ed797e753b788c8cd622a16d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 16:40:59 2024 +1100 Update llama.py commit 1c4ce70151fbd9c4c63cd527ed988e9dd28b668a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 16:37:21 2024 +1100 Update mistral.py commit f6df0c727cf189fa03ce32503a4eb6ec9df684e0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 16:31:01 2024 +1100 Update llama.py commit 34276404359c3c31d7db8e78093e3dcb9d42a5b7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 15:13:54 2024 +1100 Update llama.py commit ac1d4ccbf99852d42c843673d735f4244569a418 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 13:53:06 2024 +1100 attention mask commit 53485f6ff9288b0369600ab1c1c85ae3698fcc9e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 13:37:38 2024 +1100 Update mistral.py commit c9b0d1a4ac78fbe799892c056942edd906256940 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:29:52 2024 +1100 Update save.py commit 8e8fb3172f8b33f810032b38cdb6d2e760a464a3 Merge: 0a41484 `44e304b` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:29:35 2024 +1100 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly commit 0a41484200b86e1485703e922c22b509b67a9d68 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:27:10 2024 +1100 Update save.py commit 25bc201602412b65715d0fb78014efaa661df105 Merge: f26c3f7 `092d558` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:20:15 2024 +1100 Merge branch 'main' into nightly commit f26c3f796076b1c35bc936c4fad52fa070b513a5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:18:19 2024 +1100 attention mask commit effb5322c019e4054d6512ce32755660135a2678 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:08:19 2024 +1100 Update llama.py commit a93d9c89ab0e6ad60035add62ac46ee7f68839e3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 04:08:03 2024 +1100 Update mistral.py commit 282b462b32867c74360ad69bd25bdbd49d8f70e6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 03:59:23 2024 +1100 labels commit e624c4e0ddc6dfe5f499c8edbb4a97334aa4af3f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 03:56:54 2024 +1100 Update llama.py commit bdfbcad1b516efdaeb47aec2ecf0d7acfdb53cc5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 03:55:23 2024 +1100 Update llama.py commit e9595610c5685e080ab437a3e27bbb1e9ce24440 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 03:49:54 2024 +1100 attention_mask commit fb7163224e21262031767023451da0cf7bdcd007 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 02:34:03 2024 +1100 Update fast_lora.py commit 3dcb65c8e9538ebbe6e1b4fa1760620e5483c8cb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 01:27:46 2024 +1100 Update fast_lora.py commit 64f4fcd933117014c9d29a385388558a200c7fe3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 01:17:27 2024 +1100 Update fast_lora.py commit 4c5796ca779f37497bce05f5453a89a869615822 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 28 00:45:55 2024 +1100 Update fast_lora.py commit feb350a2d76d9e647c3b6f0190c49ad13eebaa11 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 23:20:41 2024 +1100 Update fast_lora.py commit 90c0670ee6f852c455a6aecb0cc5c6a117b53a57 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 20:39:19 2024 +1100 Update fast_lora.py commit 283c22ac919c7caf684b41c372ae82f5ccc81543 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 20:37:43 2024 +1100 Update fast_lora.py commit 80ad5504918230d51de5eac0514b6260f3be9052 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 20:17:08 2024 +1100 Update fast_lora.py commit 10f745eb24160b77c8b65a10f2c7b3b5ac107c96 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 20:04:55 2024 +1100 Update swiglu.py commit eb5bbeacbc4f9b5e1ce54ffa5fb5478d259b6364 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:53:57 2024 +1100 Update fast_lora.py commit 910ca45dc9b9b7e51f18d4c9f95e49b15b398511 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:38:28 2024 +1100 Update fast_lora.py commit 01a614f004b521bfbdc359781f1db52341b52733 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:29:53 2024 +1100 Update fast_lora.py commit fb6cf56e08469585ff872d9b441ad00627d1f62b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:18:59 2024 +1100 Update fast_lora.py commit ca3a548ab28ae24c6272ba3c7fc47a18a478e5bc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:05:02 2024 +1100 Update swiglu.py commit 5e7c46d2d686c5ee0b8969c2adde7d68fbedba4c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 19:03:04 2024 +1100 Swiglu commit 96190cc1663060778278c72aedeab343b8ebb4f7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 18:21:29 2024 +1100 Update fast_lora.py commit 3aad1a1050f55d99d1dfffc9c4404223608ab067 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 18:15:34 2024 +1100 Update fast_lora.py commit 9d8a76528badda5e089b83fd35f504ebe8173fe6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 18:00:41 2024 +1100 Update fast_lora.py commit c7296a2b74e2a82cf019ad40e5b7b8c41ac8044b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 18:00:22 2024 +1100 Update fast_lora.py commit 2bcada7bd0483bf670a9e803185dfaea28626b19 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 17:47:54 2024 +1100 Update fast_lora.py commit 4690efa40406586729d414f9a8fff3cdf55fa4cf Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 17:38:30 2024 +1100 Update pyproject.toml commit 56abd17610b4ebfe97518d0c78a7e4a6c7ad9374 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:50:47 2024 +1100 Works? commit 9641093fcdd3e5a27cb2f58ff766f26ce41f063d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:49:36 2024 +1100 Update llama.py commit 90ed5e5414074dca62eae6315212bca2aac3d51c Merge: 7bc939a `7da0c50` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:48:40 2024 +1100 Merge branch 'main' into nightly commit 7bc939a58f767a8ecf5b4c5a2fbfc0f15895a418 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:48:34 2024 +1100 Revert "Update llama.py" This reverts commit 9c9dc55bef7e71960bd48941e987e8b6239d6783. commit 9c9dc55bef7e71960bd48941e987e8b6239d6783 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:48:03 2024 +1100 Update llama.py commit b022d40324d4fadb3778fe11d139452574fe5541 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:47:42 2024 +1100 Update llama.py commit 6312ab1308b331b8838c3521ba77138ec6d6f241 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:47:01 2024 +1100 Update llama.py commit e641b963545b8bfdbac0c169a9604a73990b9ab1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:46:47 2024 +1100 Update llama.py commit 7af96f1082a69448749c679ff64e10005c4a6fc9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:20:58 2024 +1100 Update save.py commit 04596b393ee977e96a66f25fafc041d37c278848 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:19:59 2024 +1100 Update save.py commit 8f0930160811cf9f231401bc78f444e1664890c3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:18:25 2024 +1100 Update swiglu.py commit bce70372398a5e1dd2f8747bf5008784761c6983 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:16:38 2024 +1100 Update fast_lora.py commit 41a6c4a73f50ebad3f261886eef3ae59b1375272 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:15:37 2024 +1100 Update llama.py commit ada0caaf3b9924b7cd002f093f3f77124477e0e8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 04:03:47 2024 +1100 Update utils.py commit 92ad1291a42007b5973ae0da790d93f68f597e8f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:58:21 2024 +1100 Update fast_lora.py commit 92aa6c2b549cf452d873d259d1b580f922e3e32b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:51:53 2024 +1100 Update save.py commit 8652bb3bc1bd9d451ca38ff5f8d4fe5d4bef55aa Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:38:33 2024 +1100 Update fast_lora.py commit 81839c67fe9b98434ee7d6ed7f84f4923895d0e0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:38:19 2024 +1100 Update fast_lora.py commit cafc9c7e8ab3ae901693bc27b2991647fdfeeec1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:36:27 2024 +1100 Update fast_lora.py commit 1b3e0cb5759a023401fbd5d99dfc4c4749b7b10f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:23:50 2024 +1100 Update fast_lora.py commit 7e73002e86550a78928723a72c9c957d124670b4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 03:12:53 2024 +1100 Update fast_lora.py commit df1cd5fede55a7a90365658520a0d2189825f504 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 02:52:54 2024 +1100 Update fast_lora.py commit ea8f10317d9af2d703297c9ffc8be23895d35a20 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 02:34:21 2024 +1100 Update fast_lora.py commit 5e33ad3746b850c4360ef66280698772be5fdad2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 02:22:15 2024 +1100 Update fast_lora.py commit c8a5640051fd68514270f34db8d077d9c6257bfc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 02:19:00 2024 +1100 Update fast_lora.py commit 779c147a168e54f767295dcb2d431e01c5f8e568 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 01:28:03 2024 +1100 Update fast_lora.py commit dc9cb2a69fa903f1c083e385fca6c7d89fb6a0d3 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sat Jan 27 01:16:31 2024 +1100 Update fast_lora.py commit 5ee72e2c261ed6ec9980082c8693f1680a455c89 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 23:48:17 2024 +1100 Update fast_lora.py commit 6ac5c9b7e21ea570689464d77aa00e53954156c7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 23:33:17 2024 +1100 Update fast_lora.py commit 402d3d5150a8aebb81b6be392703bf206e928972 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 23:14:44 2024 +1100 Update fast_lora.py commit 8a656414ed0651f3fdb161ee387e8ffe97af5034 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 23:06:06 2024 +1100 Update fast_lora.py commit 3302d4982188a0f53d18f0e319f64799d345228f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 22:29:38 2024 +1100 Update fast_lora.py commit 50cbce636fa9d59fe179166bed2cd15c6d9c5735 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 22:21:54 2024 +1100 Update swiglu.py commit cc0f00f3b7311353ac57b482689f7736a10c6c81 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 22:09:32 2024 +1100 Update fast_lora.py commit 0f2ba68ea92cfdbbf6296a7dd58a7fa680c9c235 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 22:07:10 2024 +1100 Update swiglu.py commit 045c2544199bb614701516d4425983e4eb7a2fd8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 20:06:52 2024 +1100 Update fast_lora.py commit fdb861acc95e0fdce29316bde26b91e3f8b94644 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 20:04:51 2024 +1100 Update fast_lora.py commit a9691221ccc834f49aeba075d7223faa57265f3e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:41:48 2024 +1100 Update fast_lora.py commit 4bf0dc42f74e10ad269bb9fd232619174d63e93a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:30:18 2024 +1100 Update fast_lora.py commit 8f101868c888f61c235b493f56da49de664d0188 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:21:00 2024 +1100 Update fast_lora.py commit 372f6d18afd4cbcc21748a228ef49e7d39c2b81a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:20:53 2024 +1100 Update fast_lora.py commit 560253b2d032f1338bb546e1f55411878d4efb56 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:12:08 2024 +1100 Update fast_lora.py commit 3555215a01b0a1dbff6a7d8a8de3b12180b84820 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 19:00:22 2024 +1100 Update fast_lora.py commit 72eb3aba46b5b22fcbd43f65c5cdc3dc7e82849e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 18:19:36 2024 +1100 Update fast_lora.py commit 2fba70e173d69dab06b3281e3e7f033733fa3999 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 18:11:43 2024 +1100 Update llama.py commit 08de831ccd1ca68589c829cedcf861db1915e6be Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 18:04:59 2024 +1100 Update fast_lora.py commit 43023a9c0b23a087c6f7ae8ddbb35a37539b12d1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 17:44:10 2024 +1100 Update llama.py commit e96e52b6e4a2c1b8404469cb5b768aab703b9852 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 17:36:40 2024 +1100 Update fast_lora.py commit 203cadfe1e5dd948991a40f5a18ae85c134f92cb Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 17:25:36 2024 +1100 Update fast_lora.py commit 812839696211b026430d4f21520b63539b12e7f2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 17:13:09 2024 +1100 Update fast_lora.py commit b0b64f4a7daadc04e0ce8e88a1c0db809f3247db Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 17:04:33 2024 +1100 Update fast_lora.py commit 2a0067e9e9e433717eb8d0d079db52a9caff0c18 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 16:43:50 2024 +1100 Update fast_lora.py commit f478f506a42211e4f16a4b60dea274553ee8e748 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 16:16:32 2024 +1100 Update fast_lora.py commit e5cba4b52e3607b126c56c9838044eaec3c677de Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 16:08:10 2024 +1100 Update fast_lora.py commit 3c965a0d03bcb0e5ee31908e7c68bad308c379b0 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 14:06:25 2024 +1100 Update fast_lora.py commit b11a286026c87c311616722dc4c6aaf897e4dd9d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 13:59:57 2024 +1100 Update fast_lora.py commit ef25e3c8840ddbc4068de346f5c7de5a32b995b5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 03:49:48 2024 +1100 Update fast_lora.py commit c5d474a253e2acaaadae771dae753b8839706b1e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 03:15:23 2024 +1100 Repatch commit 55991a1520c44f1878f93cf2953211e029e3d785 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 02:41:15 2024 +1100 Update swiglu.py commit 98b2ae94252c68b160f491477a6c19fb0bf61640 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 02:07:35 2024 +1100 Update llama.py commit 398d7644638749ef376fc3473c1f42762b020e00 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Fri Jan 26 01:33:23 2024 +1100 Update llama.py commit 175d767549b7fb1dc353c4eacafbc43c2e91db72 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 23:35:56 2024 +1100 remove patching commit 58e3d1bdb303cef61599ba72d53280c3be84c0d9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 23:25:17 2024 +1100 Update fast_lora.py commit 1d8639b3fb789d150e5e2133c0b04f9e87674cce Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 23:14:37 2024 +1100 Update fast_lora.py commit e76c47b351b66a601798d1d8384bf464413b58b7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 19:05:43 2024 +1100 Fix saving and bnb-4bit commit 8633edbc407f59d56482c1b63304feafe0498325 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 03:55:26 2024 +1100 Update pyproject.toml commit f27e2892da0daa7d75648e0a650b88269bf97425 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 03:47:23 2024 +1100 Update mapper.py commit 5fad4245b89022ff02991873753990968d025c9d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 03:46:23 2024 +1100 Graceful FA2 error + torch 2.1.1 commit dacd803f3ac014a1d0343ebf0d63d7801571b6ea Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Thu Jan 25 02:29:37 2024 +1100 Update to transformers 4.37 commit caecfd41b0d8517ce8e5854dd979ba5fd500f9d6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 23:23:05 2024 +1100 incorrect inference commit 0e0ec746f05d8c916e093e79300c19f3c64357ae Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 19:44:45 2024 +1100 Update mistral.py commit 70dd0dfcd93e59c971cb3405d23906de3901c4c2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 19:28:17 2024 +1100 Update mistral.py commit 1e938e261e2f33c9b4bea25e50fc4bc33c29378e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 19:23:58 2024 +1100 q_len issue commit 18fd695ddd9d5ab74d3e60def982a0126c93c785 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 19:17:42 2024 +1100 q_len == 1 commit 4ac402a3236b3577d50a1a1e17fc5f6c7f992a28 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 19:11:17 2024 +1100 hidden_states commit d20dc61420c439ba7704cc75247f8a913a016a37 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 18:04:20 2024 +1100 Update llama.py commit e473fadd70603df8fd9d9ebc95299c2f9e808545 Merge: 1d9d912 `04f8771` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 18:04:10 2024 +1100 Merge branch 'main' into nightly commit 1d9d912cfc3813d3a0823576ca5c87986d4c12a9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 03:47:28 2024 +1100 Fast LoRA saving commit 7d0642194fa0f265ed73ea86a1ed23c46e842cae Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 03:36:50 2024 +1100 LoRA commit 54a593140d5eaa1df938540bf7355a08d5fbd59d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:44:52 2024 +1100 Update llama.py commit 71b1df10ed170f0b95bbf2a5faf03bef358a5f7d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:22:37 2024 +1100 Update llama.py commit 83a7471dbc526269cb7bfe246b8814990158f117 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:18:37 2024 +1100 Update llama.py commit c4646216103ead604847d01fe7c060da357a6fe2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:13:01 2024 +1100 Update llama.py commit 3b983313a2f4f5a040582c4705fbc4284e313957 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:09:35 2024 +1100 Update llama.py commit 8d6472ec3fb1521c652beee8de8f5dc6f5363800 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:03:25 2024 +1100 Update llama.py commit 259532e00abf130f0279963de8d92ba8c49965b5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 02:00:10 2024 +1100 Update llama.py commit 4ded02ff45c7aca09aae3d3f9e586640133b600f Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:44:10 2024 +1100 Update llama.py commit 135511243f36d931a40e5290ab665e3a98cda9ba Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:41:20 2024 +1100 RoPE commit 264e82984d77540dcdf3cdd14d278eca8c7b58ca Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:37:36 2024 +1100 Update llama.py commit a4f2fbbdd84e82e571740bdc3a7ecea6ee263aa8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:33:51 2024 +1100 Update llama.py commit 43acf766e4a03edafa491baadd174afc4e17af1e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:29:03 2024 +1100 Fast inference RoPE commit 9a176bf85c818024c9e4ea0a050bffcd28933830 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 01:06:34 2024 +1100 Update llama.py commit d0b9fbac2ddafd1463b95fe2fb842d360690a43d Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Tue Jan 23 00:32:57 2024 +1100 inference commit 48298427f7ce75eae60722575bd2ed751a4bc43c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 22:34:33 2024 +1100 Update utils.py commit e473e8ec245d0dad543adeb5146672012b628984 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 22:31:38 2024 +1100 Update utils.py commit c2e84fcdb342158319cb1509ca94c6993e3aa868 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 22:26:55 2024 +1100 No print commit bdbc9ade4182cfd52623a19ee75e668aab3bd1bc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 22:21:29 2024 +1100 Update utils.py commit 08a32072a3d03e61cee0c762bdb7e1ee3e1a75f2 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 20:04:27 2024 +1100 Update utils.py commit a71d5d12b8b1f5f87b5fecc44ce607ec26e6c2fd Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 20:01:59 2024 +1100 fast_linear_forward commit 012dcc18c752826ef8504e29618100c04bf243fc Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 19:36:17 2024 +1100 Apache 2 commit 95eff54ad652ee1ec2be9c5fb874986adf69c6ff Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 19:31:34 2024 +1100 Max sequence lengths commit 1dd2df455fd7d0dc887046c5e23ba41878f6a962 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 18:18:23 2024 +1100 Mistral correct RoPE scaling commit c47f40929539a0bba5a672c43ee6385a6f168c0a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 04:33:44 2024 +1100 Update llama.py commit dd1a33591a95d13d7b474c29c12001dfd27f4e75 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 04:28:24 2024 +1100 Update save.py commit 64b2e2335fbda4c7272eeef35f8ab59d4c15107a Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 04:25:37 2024 +1100 Update llama.py commit 60d2993a656b30f662c61671e81f501825f251f9 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 04:18:42 2024 +1100 fast inference commit 0955f00573ffd05409d826f8243b7629575cb8b6 Merge: 0e0c7b7 `3a9b2de` Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Mon Jan 22 01:58:00 2024 +1100 Merge branch 'main' into nightly commit 0e0c7b7c3dd4ae23a51bd6792551efa1a980c2a1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 22:18:53 2024 +1100 Update llama.py commit 4cdedbc55740990784f256997f035b0bc8cf8cf5 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 20:06:14 2024 +1100 Update llama.py commit 139330fa47cc0735799cf34fc7c422cae199342b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 19:21:56 2024 +1100 Update llama.py commit b78112c684a78ea7f7d827fb934793108009a7a7 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 19:10:48 2024 +1100 Update llama.py commit 8429ed085940b93f7fb2859cb520e2ef42c33ab8 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 19:01:45 2024 +1100 Update llama.py commit dcce4db9be1b8b390e2cd76da5b929b9faab84e4 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 19:01:28 2024 +1100 Update mistral.py commit afad331c5ba7d48c88665abb9fbad506a205a59c Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 18:52:25 2024 +1100 Update llama.py commit ec8da18e599cab7d6fdd6d4950f2b59f82b5a48e Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 18:52:15 2024 +1100 Update llama.py commit d218084d189a0dc61998a56aef70b15bd871bb45 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 18:15:55 2024 +1100 Update llama.py commit 56bf48f615a4d590b518a39f2d595f260c732ff6 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 18:06:44 2024 +1100 Update llama.py commit 95b1ac1b68f1eb3a3d62ffc7fce595cce3dbc25b Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 17:32:37 2024 +1100 Update save.py commit 74d61c09b803042ababd24815589bb2b8de440f1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 16:53:58 2024 +1100 Update llama.py commit edb68d73960a37becb5d0dc8457fc8f4766231b1 Author: Daniel Han-Chen <danielhanchen@gmail.com> Date: Sun Jan 21 16:22:28 2024 +1100 faster saving & inference	2024-03-17 22:21:36 +11:00
Daniel Han	e875e92de4	Bug fixes (#257 ) * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md * Bugs * Update fast_lora.py * Update pyproject.toml * Update fast_lora.py	2024-03-17 22:09:50 +11:00
Daniel Han	39ae3c699c	Bug fixes (#249 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update rope_embedding.py * Update rope_embedding.py * Fix bugs * Update fast_lora.py * Update fast_lora.py * Update README.md * Update README.md * GGUF * Update save.py * Update save.py * Update save.py * Update save.py * Update README.md * Update README.md	2024-03-17 02:47:05 +11:00
Qubitium	bcb0759bf7	Fix single gpu limit code overriding the wrong cuda gpu id via env (#228 )	2024-03-16 00:12:16 +11:00
HuyNguyen-hust	a9123529d0	10% faster RoPE embedding from HuyNguyen-hust (#238 )	2024-03-16 00:09:59 +11:00
Daniel Han	c545fee506	Gemma GGUF chat templates work! (#246 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py	2024-03-15 05:09:45 +11:00
Daniel Han	012db22c54	Fix Gemma GGUF (#234 ) * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py * Update save.py * GGUF incorrect * Update save.py * Update pyproject.toml * kaggle new * Update pyproject.toml * Update pyproject.toml * upcasting * Fix Colab * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml * Update pyproject.toml	2024-03-14 20:32:04 +11:00
Daniel Han	424ffbe9d5	Fix more bugs (#232 ) * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update chat_templates.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Account for DoRA * Update llama.py	2024-03-11 04:31:03 +11:00
Daniel Han	874b38db69	Saving fixes (#231 ) * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten * Update llama.py * Update llama.py * Update llama.py * Update save.py * Accuracy * Revert * Update save.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py	2024-03-10 20:09:34 +11:00
Daniel Han	67267eaf3e	Fix bugs (#230 ) * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py * Update chat_templates.py * Update save.py * Update save.py * Update save.py * Update chat_templates.py * Update llama.py * model_name * Update loader.py * Tokenizer overwritten	2024-03-10 04:54:23 +11:00
Daniel Han	2a342cca70	Fix Gemma (#223 ) * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Fix Gemma merging * Update rms_layernorm.py * Update gemma.py * Update pyproject.toml * Layernorms * Gemma precision * Update gemma.py * sqrt * Update gemma.py * Update save.py * RoPE and Gemma precision * Update rms_layernorm.py * Fix warning * Update chat_templates.py	2024-03-07 04:34:06 +11:00
Daniel Han	2104dc97de	Fix Gemma norm float32 (#217 ) * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py * Update rms_layernorm.py * Update rms_layernorm.py * Update rms_layernorm.py * Update gemma.py	2024-03-04 16:19:55 +11:00
Daniel Han	8e8bb99405	Fix Gemma fast inference (#215 ) * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py * Update gemma.py	2024-03-03 19:36:06 +11:00
Daniel Han	05a2d7d75f	Fix Gemma activation function (#214 ) * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update pyproject.toml * Small fixes * Update pyproject.toml * Approx gelu * Update geglu.py * Approx gelu * Update llama.py * Update __init__.py * Update __init__.py * Update _utils.py * Update geglu.py	2024-03-03 18:21:44 +11:00
Daniel Han	851ab78fd2	Nightly (#204 ) * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py * Update llama.py * Hotfix - fix DoRA, Gemma prompt template (#202) (#203) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py	2024-02-29 00:18:38 +11:00
Daniel Han	727fb33633	Hotfix - fix DoRA, Gemma prompt template (#202 ) * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md * Update llama.py * DoRA * Update _utils.py * Update chat_templates.py	2024-02-29 00:15:22 +11:00
Daniel Han	daac342984	2.4x faster Gemma (#197 ) * Update save.py * Update save.py * linking * llama.cpp bugs * Update save.py * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original * Gemma * Update pyproject.toml * Update mapper.py * Update fast_lora.py * FastGemmaModel * model_type * Update llama.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update fast_lora.py * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * gemma * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update fast_lora.py * Update fast_lora.py * Fast CE Loss * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * CE * Update llama.py * Update llama.py * Update cross_entropy_loss.py * Update geglu.py * Update cross_entropy_loss.py * revert * Update llama.py * Update llama.py * norm * Update gemma.py * Update gemma.py * position_ids * Update gemma.py * Update gemma.py * pos * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * revert * revert * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * rope * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * llama * Update llama.py * gemma * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update gemma.py * Update save.py * RoPE * Update llama.py * Update llama.py * Update llama.py * Update gemma.py * correct_dtype * Update gemma.py * Update cross_entropy_loss.py * Update cross_entropy_loss.py * Chat Templates * Update README.md * Update README.md	2024-02-27 01:42:10 +11:00
Daniel Han	5667edbd40	Feb 2024 Release (#187 ) * Fast inference repatch * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update mistral.py * Update __init__.py * Fix inference * Update mistral.py * fast lm_head * Remove fast path * Update rope_embedding.py * Update loader.py * LlamaAttention_fast_forward_inference * if past_key_value is not None and q_len == 1: * revert inference * Update loader.py * past_key_value * Update llama.py * Update llama.py * Fix SDPA * Update llama.py * padding * Inference * Update llama.py * Revert * Update mistral.py * faster inference * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * inference * Update llama.py * Update utils.py * faster inference * Update llama.py * revert * lm_head * Update llama.py * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * faster inference * Update llama.py * fast inference * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * torch compile * past_key_values * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update utils.py * Update llama.py * fast inference + saving config.json * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * fast inference again * more temp matrices * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * fast inference * Update mistral.py * Update llama.py * SDPA * attention_mask * New version * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update save.py * Update save.py * Torch 2.2.0 * Update save.py * mistral swa * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Fix SWA inference * Fix llm_int8_skip_modules * SWA inference * Update save.py * Update save.py * Update pyproject.toml * __version__ * __version__ * Update save.py * Update save.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Chat Templates * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * patch tokenizer * Update chat_templates.py * Saving, LlamaRotaryEmbedding issues * Update llama.py * Update mistral.py * Update mapper.py * Fix RoPE precision issues * Bugs * saving bugs * Update llama.py * readme * spaces * spaces * globals * slash * slashes * spaces * apache * Update save.py * Update save.py * Update loader.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * trainer * Update save.py * Update pyproject.toml * install * Update save.py * Update save.py * Update save.py * Update save.py * PeftModel token + saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * linking * llama.cpp bugs * Update save.py * Update save.py * saving * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update __init__.py * Update save.py * Update save.py * Update save.py * save * trainer * spaces * original	2024-02-21 03:58:59 +11:00
Daniel Han	d52ab5c4cc	Prelim Feb release (#173 ) * Works? * Update pyproject.toml * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Swiglu * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * attention_mask * Update llama.py * Update llama.py * labels * Update mistral.py * Update llama.py * attention mask * Update save.py * Update save.py * Update mistral.py * attention mask * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update dpo.py * Patch saving * Update save.py * Update save.py * patch_saving_functions * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * print * Mistral patch * Update mistral.py * Update save.py * saving * Update llama.py * Update llama.py * Fast inference repatch * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update mistral.py * Update __init__.py * Fix inference * Update mistral.py * fast lm_head * Remove fast path * Update rope_embedding.py * Update loader.py * LlamaAttention_fast_forward_inference * if past_key_value is not None and q_len == 1: * revert inference * Update loader.py * past_key_value * Update llama.py * Update llama.py * Fix SDPA * Update llama.py * padding * Inference * Update llama.py * Revert * Update mistral.py * faster inference * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * inference * Update llama.py * Update utils.py * faster inference * Update llama.py * revert * lm_head * Update llama.py * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * faster inference * Update llama.py * fast inference * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * torch compile * past_key_values * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update utils.py * Update llama.py * fast inference + saving config.json * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * fast inference again * more temp matrices * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * fast inference * Update mistral.py * Update llama.py * SDPA * attention_mask * New version * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update save.py * Update save.py * Torch 2.2.0 * Update save.py * mistral swa * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Fix SWA inference * Fix llm_int8_skip_modules * SWA inference * Update save.py * Update save.py * Update pyproject.toml * __version__ * __version__ * Update save.py * Update save.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Chat Templates * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * Update chat_templates.py * patch tokenizer * Update chat_templates.py * Saving, LlamaRotaryEmbedding issues * Update llama.py * Update mistral.py	2024-02-15 00:07:42 +11:00
Younes Belkada	077e9dc87d	add HF tagging in unsloth (#170 )	2024-02-13 18:28:42 +11:00
Daniel Han	1191e83866	Update README.md (#165 )	2024-02-09 15:59:17 +11:00
Daniel Han	f1560409c0	Update README.md (#164 )	2024-02-09 15:49:09 +11:00
Daniel Han-Chen	032702dee7	Update mapper.py	2024-02-09 03:51:59 +11:00
Daniel Han	e37814f698	Update README.md (#162 )	2024-02-08 13:11:54 +11:00
Daniel Han	5e6069167d	Nightly (#161 ) * Update fast_lora.py * Update utils.py * Update llama.py * Update fast_lora.py * Update swiglu.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Revert "Update llama.py" This reverts commit 9c9dc55bef7e71960bd48941e987e8b6239d6783. * Update llama.py * Works? * Update pyproject.toml * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Swiglu * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * attention_mask * Update llama.py * Update llama.py * labels * Update mistral.py * Update llama.py * attention mask * Update save.py * Update save.py * Update mistral.py * attention mask * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update dpo.py * Patch saving * Update save.py * Update save.py * patch_saving_functions * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * print * Mistral patch * Update mistral.py * Update save.py * saving * Update llama.py * Update llama.py * Fast inference repatch * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update mistral.py * Update __init__.py * Fix inference * Update mistral.py * fast lm_head * Remove fast path * Update rope_embedding.py * Update loader.py * LlamaAttention_fast_forward_inference * if past_key_value is not None and q_len == 1: * revert inference * Update loader.py * past_key_value * Update llama.py * Update llama.py * Fix SDPA * Update llama.py * padding * Inference * Update llama.py * Revert * Update mistral.py * faster inference * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * inference * Update llama.py * Update utils.py * faster inference * Update llama.py * revert * lm_head * Update llama.py * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * faster inference * Update llama.py * fast inference * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * torch compile * past_key_values * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update utils.py * Update llama.py * fast inference + saving config.json * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * fast inference again * more temp matrices * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * fast inference * Update mistral.py * Update llama.py * SDPA * attention_mask * New version * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update save.py * Update save.py * Torch 2.2.0 * Update save.py * mistral swa * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Fix SWA inference * Fix llm_int8_skip_modules * SWA inference * Update save.py * Update save.py * Update pyproject.toml * __version__ * __version__ * Update save.py * Update save.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py	2024-02-08 03:40:28 +11:00
Daniel Han	522e368dbc	Torch 2.2 (#157 ) * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update save.py * Update fast_lora.py * Update utils.py * Update llama.py * Update fast_lora.py * Update swiglu.py * Update save.py * Update save.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Revert "Update llama.py" This reverts commit 9c9dc55bef7e71960bd48941e987e8b6239d6783. * Update llama.py * Works? * Update pyproject.toml * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Swiglu * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update swiglu.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * Update fast_lora.py * attention_mask * Update llama.py * Update llama.py * labels * Update mistral.py * Update llama.py * attention mask * Update save.py * Update save.py * Update mistral.py * attention mask * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update dpo.py * Patch saving * Update save.py * Update save.py * patch_saving_functions * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * print * Mistral patch * Update mistral.py * Update save.py * saving * Update llama.py * Update llama.py * Fast inference repatch * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update mistral.py * Update __init__.py * Fix inference * Update mistral.py * fast lm_head * Remove fast path * Update rope_embedding.py * Update loader.py * LlamaAttention_fast_forward_inference * if past_key_value is not None and q_len == 1: * revert inference * Update loader.py * past_key_value * Update llama.py * Update llama.py * Fix SDPA * Update llama.py * padding * Inference * Update llama.py * Revert * Update mistral.py * faster inference * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * inference * Update llama.py * Update utils.py * faster inference * Update llama.py * revert * lm_head * Update llama.py * inference * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * faster inference * Update llama.py * fast inference * Update llama.py * Update llama.py * Update mistral.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * torch compile * past_key_values * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update utils.py * Update utils.py * Update llama.py * fast inference + saving config.json * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update mistral.py * fast inference again * more temp matrices * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * fast inference * Update mistral.py * Update llama.py * SDPA * attention_mask * New version * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update llama.py * Update utils.py * Update utils.py * Update save.py * Update save.py * Torch 2.2.0 * Update save.py * mistral swa * Update save.py * Update save.py * Update save.py * Update save.py * Update save.py * Fix SWA inference * Fix llm_int8_skip_modules * SWA inference * Update save.py * Update save.py * Update pyproject.toml * __version__ * __version__ * Update save.py * Update save.py * Update mistral.py	2024-02-07 04:40:50 +11:00

1 2 3 4

187 commits