diff --git a/Home.md b/Home.md index d44eb86..b3e0a5a 100644 --- a/Home.md +++ b/Home.md @@ -1018,6 +1018,7 @@ We value engineers who are proactive, independent and who ship features and idea * Use torch AO and add MXFP4 support in preparation for Blackwell. * Add fully optimized Deepseek finetuning support. * Add full finetuning / pretraining support in Unsloth - Triton kernels. + * FSDPv2 + QLoRA (maybe via Torch AO) + `torch.compile`. **For for details, email me, or ask me questions on Discord! For more information about us, see our:** 1. CUDA / GPU Mode lecture Talk. [Youtube link](https://www.youtube.com/watch?v=hfb_AIhDYnA)