From 4a7768a93f9f4f8f2ec1d6d04d5a47d5afac4423 Mon Sep 17 00:00:00 2001 From: Daniel Han Date: Sat, 26 Oct 2024 12:51:55 -0700 Subject: [PATCH] Updated Home (markdown) --- Home.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/Home.md b/Home.md index 4bcdfc5..cf92006 100644 --- a/Home.md +++ b/Home.md @@ -995,7 +995,7 @@ services: dockerfile: Dockerfile ``` -### We are hiring +### - We are hiring [Updated 26th October 2024] Want to work on Triton kernels, optimizations, maths algorithms to make LLMs and AI more accessible? Come join us! We currently have over 2.5 million monthly Hugging Face model downloads and collaborate with Meta, Google, Hugging Face on open models. We fixed dozens of bugs in Gemma, Llama, Mistral, helped fix a gradient accumulation bug, showed how gradient checkpointing can be improved to reduce VRAM and more! We value engineers who are proactive, independent and who ship features and ideas quickly - if stuff breask, that's fine with us! On our criteria: @@ -1007,4 +1007,6 @@ We value engineers who are proactive, independent and who ship features and idea * Utilies to export Unsloth finetunes to vLLM & Ollama - LoRA adapters only. Provide a standalone serving interface to vLLM * Add float8 + QLoRA support via Torch AO into Unsloth. Show training losses match. Reproducible Colab with L4 GPU. Do not use `use torch.compile`. * Bitsandbytes 4bit QLoRA dequant Triton kernel - must be faster than CUDA version. - * Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent. \ No newline at end of file + * Add TPU & AMD support into Unsloth. TPU - Colab & Kaggle notebooks. AMD - Runpod equivalent. + +For for details, email me, or ask me questions on Discord! \ No newline at end of file