ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/tests/saving
History
Exact
Anmol Mishra 4e9d772d36
 fix: preserve tokenizer eos token on merged saves (#5451) 
Preserves the source tokenizer's eos_token in tokenizer_config.json after merged saves so runtimes such as vLLM read the correct stop token. Centralized inside the patched tokenizer save_pretrained so all save paths (merged_16bit, GGUF, torchao, push_to_hub) benefit, with filename_prefix support.

Fixes #5386
2026-05-17 06:44:23 -07:00
..
gpt-oss-merge Revert "[FIX] Vllm guided decoding params (#3662)" 2025-12-01 05:43:45 -08:00
language_models Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
non_peft chore: fix typo cleanup across tests and backend strings (#5152) 2026-04-24 12:51:27 +01:00
text_to_speech_models Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
vision_models chore: fix typo cleanup across tests and backend strings (#5152) 2026-04-24 12:51:27 +01:00
test_fix_sentencepiece_gguf_robustness.py fix: patch CONTROL type for special tokens in sentencepiece GGUF export (#5080) 2026-04-23 03:11:35 -07:00
test_patch_saving_none_tokenizer.py Fix tokenizer save gemma (#5115) 2026-04-22 09:03:20 -07:00
test_preserve_tokenizer_eos_token.py fix: preserve tokenizer eos token on merged saves (#5451) 2026-05-17 06:44:23 -07:00
test_save_shell_injection.py Add regression test for shell injection fix in GGML conversion (#4773) 2026-04-02 00:10:47 -07:00
test_unsloth_save.py Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00