LFM2-8B-A1B and any other lfm2_moe checkpoint were missing from the transformers tier tables, so they fell through to the default 4.57.x sidecar, which does not register lfm2_moe and errors with "not supported yet in transformers==4.57.6". Only lfm2_vl was listed. Add Lfm2MoeForCausalLM / lfm2_moe to the 5.3.0 tier (lfm2_moe is registered in transformers 5.3.0). get_transformers_tier now returns 530 for LFM2-8B-A1B and the model loads and trains as expected. |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| hub | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| storage | ||
| tests | ||
| utils | ||
| __init__.py | ||
| _platform_compat.py | ||
| cloudflare_tunnel.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||
| startup_banner.py | ||