diff --git a/README.md b/README.md index 24bc2a89f1..53a52c31c2 100644 --- a/README.md +++ b/README.md @@ -1,13 +1,15 @@ -## 2x faster 50% less memory LLM finetuning +## 2x faster 50% less memory LLM local finetuning * Manual autograd engine. * All kernels written in OpenAI's Triton language. * 0% loss in accuracy. * No change of hardware necessary. Supports Tesla T4, RTX 20, 30, 40 series, A100, H100s * Flash Attention * Train Alpaca **fully locally in 13 hours from 23 hours.** - +* Train Open Assistant **fully locally in 4 hours from 8 hours.** +* Check out [Unsloth Pro and Max](https://unsloth.ai/) codepaths for **30x faster training**! +
@@ -80,6 +82,9 @@ trainer = .... Use Huggingface's Trainer and dataset loading 1. Support sqrt gradient checkpointing which further slashes memory usage by 25%. 2. Does not support non Llama models - we do so in the future. +# Unsloth Pro and Max +1. If you want + # Performance comparisons on 1 Tesla T4 GPU: **Time taken for 1 epoch**