ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated Home (markdown)

Daniel Han 2024-10-29 21:45:02 -07:00
commit f269fa2e3a
1 changed files with 13 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

19
Home.md

@ -998,12 +998,14 @@ services:
```
### -We are hiring
[Updated 29th October 2024] Want to work on Triton kernels, optimizations and maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over 2.5 million monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in Gemma, Llama, Mistral, helped fix a gradient accumulation bug, showed how gradient checkpointing can be improved to reduce VRAM and more!
[Updated 29th October 2024] Want to work on cool Triton kernels, optimizations and maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over [2.5 million](https://huggingface.co/unsloth) monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in [Gemma](https://x.com/danielhanchen/status/1765446273661075609), Llama, Mistral, helped fix a [gradient accumulation bug](https://x.com/danielhanchen/status/1846235913443262891), showed how [gradient checkpointing](https://unsloth.ai/blog/long-context) can be improved to reduce VRAM and more!
We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breaks, that's fine with us! On our criteria:
We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breaks, that's fine with us!
1. Debug, solve issues and make 3 PRs that get added into Unsloth. These must be urgent bugs / issues.
2. (OR) Create a high quality PR on 1 item below (only 1 needed):
**On our criteria for being accepted as an intern / full time engineer**
1. Debug, solve urgent issues / bugs and make 3 PRs for interns / 6 PRs for a full time engineer
2. **OR** Create a high quality PR on 1 item below (only 1 needed):
* Somewhat optimized QLoRA for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - make this faster. Provide a Colab notebook tutorial on how to use it. Must fit in 1 x 16GB Tesla T4.
* Unoptimized Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support.
* Utilities to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang
@ -1011,7 +1013,12 @@ We value engineers who are proactive, independent and who ship features and idea
* Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version.
* Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent.
* Use torch AO and add MXFP4 support in preparation for Blackwell.
* Add optimized Deepseek finetuning support.
* Add fully optimized Deepseek finetuning support.
* Add full finetuning / pretraining support in Unsloth - Triton kernels.
For for details, email me, or ask me questions on Discord!
For for details, email me, or ask me questions on Discord! For more information about us, see our:
1. CUDA / GPU Mode lecture Talk. [Youtube link](https://www.youtube.com/watch?v=hfb_AIhDYnA)
2. Low Level Technicals of LLMs. [Youtube link](https://www.youtube.com/watch?v=pRM_P6UfdIc)
3. Fixing bugs in Llama, Mistral, Gemma. [Youtube link](https://www.youtube.com/watch?v=TKmfBnW0mQA)
4. PyTorch Conference Mini Talk. [Youtube link](https://www.youtube.com/watch?v=hfb_AIhDYnA)
5. PyTorch Engineers Meeting Talk. [Youtube link](https://www.youtube.com/watch?v=MQwryfkydc0)