ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated Home (markdown)

Daniel Han 2024-11-10 16:15:48 -08:00
commit 06bff61598
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
Home.md

@ -1001,7 +1001,7 @@ services:
***
[Updated 5th November 2024] Want to work on cool Triton kernels, optimizations and maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over [2.5 million](https://huggingface.co/unsloth) monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in [Gemma](https://x.com/danielhanchen/status/1765446273661075609), [Llama & Phi](https://unsloth.ai/blog/phi3), [Mistral](https://unsloth.ai/blog/mistral-nemo), helped fix a [gradient accumulation bug](https://x.com/danielhanchen/status/1846235913443262891), showed how [gradient checkpointing](https://unsloth.ai/blog/long-context) can be improved to reduce VRAM and more!
[Updated 10th November 2024] Want to work on cool Triton kernels, optimizations and maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over [2.5 million](https://huggingface.co/unsloth) monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in [Gemma](https://x.com/danielhanchen/status/1765446273661075609), [Llama & Phi](https://unsloth.ai/blog/phi3), [Mistral](https://unsloth.ai/blog/mistral-nemo), helped fix a [gradient accumulation bug](https://x.com/danielhanchen/status/1846235913443262891), showed how [gradient checkpointing](https://unsloth.ai/blog/long-context) can be improved to reduce VRAM and more!
We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breaks, that's fine with us! Internships are 3 monthly renewable roles ($100K - $120K USD pa) SF focused or remote. Full time roles ($150K - $250K USD pa with equity) SF only. We're [Y Combinator S24](https://www.ycombinator.com/companies/unsloth-ai) alumni & backed by Github!
@ -1009,7 +1009,7 @@ We value engineers who are proactive, independent and who ship features and idea
1. Debug, solve urgent issues / bugs and make 3 merged PRs for interns / 6 merged PRs for a full time engineer
2. **OR** Create a high quality accepted PR on 1 item below. 📚=Software Eng 🔢=Kernels 🛠️=Infra:
* 📚Somewhat optimized QLoRA finetuning for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - make this faster. Provide a Colab notebook tutorial on how to use it. Must fit in 1 x 16GB Tesla T4.
* 📚**Optimized** QLoRA finetuning for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - **make this faster**. Provide a Colab notebook tutorial on how to use it. **Do NOT copy paste from Diffusers. Show what optimizations you did.**
* 📚Unoptimized Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support.
* 📚Utilities to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang
* 🔢Add float8 + QLoRA finetuning support via Torch AO into Unsloth.
@ -1023,7 +1023,7 @@ We value engineers who are proactive, independent and who ship features and idea
* 🛠️Modal but using spot instances
* 🔢Use binary tensor cores for fast Hamming distances. Show this works in approximate nearest neighbors
* 🔢Make `torch.compile` work on gradient checkpointing with compiled autograd and removing `torch._dynamo.disable`
* 🔢Port Flex Attention to Unsloth for all models (Llama, Mistral, Gemma etc)
* 🔢Port Flex Attention to Unsloth for all models (Llama, Mistral, Gemma etc). Must be torch compilable and faster than naive SDPA.
**For for details, email me, or ask me questions on Discord! For more information about us, see our:**
1. CUDA / GPU Mode lecture Talk. [Youtube link](https://www.youtube.com/watch?v=hfb_AIhDYnA)