diff --git a/Home.md b/Home.md index 3dfa64e..e139d53 100644 --- a/Home.md +++ b/Home.md @@ -1005,7 +1005,7 @@ We value engineers who are proactive, independent and who ship features and idea * Somewhat optimized QLoRA for FLUX / stable diffusion models. Diffusers just added 4bit QLoRA support - make this faster. Provide a Colab notebook tutorial on how to use it. Must fit in 1 x 16GB Tesla T4. * Unoptimized Apple Silicon / Metal support LoRA - MLX, Core ML Tools etc support. * Utilies to export Unsloth finetunes to vLLM, SGLang & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM, SGLang - * Add float8 + QLoRA support via Torch AO into Unsloth. Show training losses match. Reproducible Colab with L4 GPU. Do not use `use torch.compile`. + * Add float8 + QLoRA support via Torch AO into Unsloth. Show training losses match. Reproducible Colab with L4 GPU. Do not use use `torch.compile`. * Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version. * Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent. * Use torch AO and add MXFP4 support in preparation for Blackwell.