ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated Home (markdown)

Michael 2024-11-19 23:07:52 -08:00
commit f961aac2ad
1 changed files with 1 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
Home.md

@ -1009,8 +1009,7 @@ We value engineers who are proactive, independent and who ship features and idea
1. Debug, solve urgent issues / bugs and make 3 merged PRs for interns / 6 merged PRs for a full time engineer
2. **OR** Create a high quality accepted PR on 1 item below. 📚=Software Eng 🔢=Kernels 🛠️=Infra:
* 📚**Optimized** QLoRA finetuning for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - **make this faster**. Provide a Colab notebook tutorial on how to use it. **Do NOT copy paste from Diffusers. Show what optimizations you did.**
* 📚Unoptimized Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support.
* 📚Unoptimized or optimized (extra points) Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support.
* 📚Utilities to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang
* 🔢Add float8 + QLoRA finetuning support via Torch AO into Unsloth.
* 🔢Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version.