From 23c29e174239d138479220d490208b1aa0a4c8dc Mon Sep 17 00:00:00 2001 From: Daniel Han Date: Wed, 30 Oct 2024 01:26:59 -0700 Subject: [PATCH] Updated Home (markdown) --- Home.md | 1 + 1 file changed, 1 insertion(+) diff --git a/Home.md b/Home.md index d44eb86..b3e0a5a 100644 --- a/Home.md +++ b/Home.md @@ -1018,6 +1018,7 @@ We value engineers who are proactive, independent and who ship features and idea * Use torch AO and add MXFP4 support in preparation for Blackwell. * Add fully optimized Deepseek finetuning support. * Add full finetuning / pretraining support in Unsloth - Triton kernels. + * FSDPv2 + QLoRA (maybe via Torch AO) + `torch.compile`. **For for details, email me, or ask me questions on Discord! For more information about us, see our:** 1. CUDA / GPU Mode lecture Talk. [Youtube link](https://www.youtube.com/watch?v=hfb_AIhDYnA)