unsloth/unsloth/kernels
danielhanchen 1f85f39e0a Fix FBGEMM/CUTLASS errors on SM100 (Blackwell) GPUs
This PR fixes the "Arch conditional MMA instruction used without targeting
appropriate compute capability. Aborting." errors that occur when using
FBGEMM on Blackwell GPUs (B200/B100, SM100).

Changes:
- Add stderr filters in import_fixes.py for CUTLASS/FBGEMM MMA errors
- Add warning filters for various deprecation messages
- Update check_fbgemm_gpu_version() to disable FBGEMM instead of raising
  an error when old versions are detected
- Update test_has_fbgemm() in fp8.py to catch broader CUTLASS/CUDA errors
  and gracefully fall back to Triton kernels
- Update loader_utils.py to disable FBGEMM instead of raising ValueError
  for old fbgemm_gpu versions

The key behavior change is that FBGEMM errors no longer crash the script.
Instead, FBGEMM is disabled and Triton kernels are used automatically.
This allows Unsloth to work on SM100 GPUs where CUTLASS SM90 kernels fail,
and also gracefully handles old FBGEMM versions.
2026-01-08 04:14:53 +00:00
..
moe Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
__init__.py Formatting & bug fixes (#3563) 2025-11-07 06:00:22 -08:00
cross_entropy_loss.py Improve TRL compatibility and GRPO state restore 2026-01-05 07:02:36 +00:00
fast_lora.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2025-12-30 15:58:41 +00:00
flex_attention.py Revert "[FIX] Vllm guided decoding params (#3662)" 2025-12-01 05:43:45 -08:00
fp8.py Fix FBGEMM/CUTLASS errors on SM100 (Blackwell) GPUs 2026-01-08 04:14:53 +00:00
geglu.py Revert "[FIX] Vllm guided decoding params (#3662)" 2025-12-01 05:43:45 -08:00
layernorm.py Revert "[FIX] Vllm guided decoding params (#3662)" 2025-12-01 05:43:45 -08:00
rms_layernorm.py SFT sample packing (#3566) 2025-12-09 17:36:45 -08:00
rope_embedding.py fastrope fix for zero strided tensors (#3782) 2025-12-28 21:21:48 -08:00
swiglu.py Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
utils.py Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00