ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated Home (markdown)

Daniel Han 2024-11-06 00:16:44 -08:00
commit caad72e964
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
Home.md

@ -1022,7 +1022,7 @@ We value engineers who are proactive, independent and who ship features and idea
* 🛠️Using spot instances to train models with a checkpoint recovery mechanism (like SkyPilot)
* 🛠️Modal but using spot instances
* 🔢Use binary tensor cores for fast Hamming distances. Show this works in approximate nearest neighbors
* 🔢Make `torch.compile(fullgraph = True)` with no graph breaks work on PEFT QLoRA finetuning - remove all hooks
* 🔢Make `torch.compile` work on gradient checkpointing with compiled autograd and removing `torch._dynamo.disable`
* 🔢Port Flex Attention to Unsloth for all models (Llama, Mistral, Gemma etc)
**For for details, email me, or ask me questions on Discord! For more information about us, see our:**