diff --git a/Home.md b/Home.md index 0c3c3eb..16d8bb8 100644 --- a/Home.md +++ b/Home.md @@ -998,15 +998,15 @@ services: ``` ### -We are hiring -[Updated 26th October 2024] Want to work on Triton kernels, optimizations, maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over 2.5 million monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in Gemma, Llama, Mistral, helped fix a gradient accumulation bug, showed how gradient checkpointing can be improved to reduce VRAM and more! +[Updated 29th October 2024] Want to work on Triton kernels, optimizations and maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over 2.5 million monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in Gemma, Llama, Mistral, helped fix a gradient accumulation bug, showed how gradient checkpointing can be improved to reduce VRAM and more! -We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breask, that's fine with us! On our criteria: +We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breaks, that's fine with us! On our criteria: 1. Debug, solve issues and make 3 PRs that get added into Unsloth. These must be urgent bugs / issues. 2. (OR) Create a high quality PR on 1 item below (only 1 needed): * Somewhat optimized QLoRA for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - make this faster. Provide a Colab notebook tutorial on how to use it. Must fit in 1 x 16GB Tesla T4. * Unoptimized Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support. - * Utilies to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang + * Utilities to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang * Add float8 + QLoRA support via Torch AO into Unsloth. Show training losses match. Reproducible Colab with L4 GPU. Do not use use `torch.compile`. * Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version. * Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent.