unsloth/unsloth
Daniel Han 12f8525bc6
Cache packed sequence metadata to reduce D2H syncs across layers (#4243)
* packing optimziation with cache to reduce D2H copy

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* cache per device to avoid race condition for multi-gpu

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add cache freeing up func

---------

Co-authored-by: ruixiangw <ruixiangw@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ruixiang <wangruixiang07@outlook.com>
2026-03-12 03:37:49 -07:00
..
dataprep Guard optional vLLM imports when extension is broken (#4068) 2026-02-15 22:09:29 -08:00
kernels fix(ROCm): restrict is_rdna() to ROCm-officially-supported RDNA GPUs (#4136) 2026-03-03 03:05:38 -08:00
models [trl] Trl v0.28 (and above) rl fixes (#4156) 2026-03-09 12:01:49 -04:00
registry Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
utils Cache packed sequence metadata to reduce D2H syncs across layers (#4243) 2026-03-12 03:37:49 -07:00
__init__.py Bug fixed version 2026-03-08 06:39:19 -07:00
_auto_install.py Add PyTorch 2.10 and xformers 0.0.34 support (#3985) 2026-02-05 05:56:26 -08:00
chat_templates.py Fix regressions from security PRs #4042, #4044, and #4045 (#4062) 2026-02-15 23:16:17 -08:00
device_type.py Conditionally enable 4bit on CDNA for bitsandbytes>=v0.49.2 (#4161) 2026-03-07 01:33:40 -08:00
import_fixes.py Also patch accelerate's is_wandb_available for trl callbacks path (#4148) 2026-03-03 08:28:55 -08:00
ollama_template_mappers.py Refactor Ollama template wiring and harden packing helpers (#3890) 2026-02-09 04:04:48 -08:00
save.py fix: update GGUF save paths to use ~/.unsloth/llama.cpp with Windows support (#4138) 2026-03-03 06:34:09 -08:00
tokenizer_utils.py Add resilience to TRL internal API reclassification (#4111) 2026-02-25 06:34:21 -08:00
trainer.py Fix auto padding free logic to respect user passed False (#4128) 2026-03-01 19:30:47 -08:00