From caad72e964dd80a721cd6cb1c6ec7f925df9d131 Mon Sep 17 00:00:00 2001 From: Daniel Han Date: Wed, 6 Nov 2024 00:16:44 -0800 Subject: [PATCH] Updated Home (markdown) --- Home.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Home.md b/Home.md index 6b7e70e..104b6f3 100644 --- a/Home.md +++ b/Home.md @@ -1022,7 +1022,7 @@ We value engineers who are proactive, independent and who ship features and idea * 🛠️Using spot instances to train models with a checkpoint recovery mechanism (like SkyPilot) * 🛠️Modal but using spot instances * 🔢Use binary tensor cores for fast Hamming distances. Show this works in approximate nearest neighbors - * 🔢Make `torch.compile(fullgraph = True)` with no graph breaks work on PEFT QLoRA finetuning - remove all hooks + * 🔢Make `torch.compile` work on gradient checkpointing with compiled autograd and removing `torch._dynamo.disable` * 🔢Port Flex Attention to Unsloth for all models (Llama, Mistral, Gemma etc) **For for details, email me, or ask me questions on Discord! For more information about us, see our:**