ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated Home (markdown)

Daniel Han 2024-10-26 12:51:55 -07:00
commit 4a7768a93f
1 changed files with 4 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

6
Home.md

@ -995,7 +995,7 @@ services:
dockerfile: Dockerfile
```
### We are hiring
### - We are hiring
[Updated 26th October 2024] Want to work on Triton kernels, optimizations, maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over 2.5 million monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in Gemma, Llama, Mistral, helped fix a gradient accumulation bug, showed how gradient checkpointing can be improved to reduce VRAM and more!
We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breask, that's fine with us! On our criteria:
@ -1007,4 +1007,6 @@ We value engineers who are proactive, independent and who ship features and idea
* Utilies to export Unsloth finetunes to vLLM & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM
* Add float8 + QLoRA support via Torch AO into Unsloth. Show training losses match. Reproducible Colab with L4 GPU. Do not use `use torch.compile`.
* Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version.
* Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent.
* Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent.
For for details, email me, or ask me questions on Discord!