3a28446a54* Comment out large unused packages from Studio setup requirements Audited all packages installed by `unsloth studio setup` against actual imports in unsloth, unsloth_zoo, and studio/backend. The following have zero imports anywhere and are the largest offenders by disk size: - gradio (148 MB) in studio.txt -- Studio uses React + FastAPI, not Gradio - executorch (41.5 MB) in extras-no-deps.txt -- no imports found - scikit-learn (31.8 MB) in extras.txt -- no imports found - MeCab (19.9 MB) in extras.txt -- Japanese tokenizer, no imports found - coremltools (10.2 MB) in extras.txt -- Apple CoreML, no imports found - uroman (4.0 MB) in extras.txt -- romanization tool, no imports found Total savings: ~255 MB (~32% of the 805 MB installed by setup). Each line is commented out with the package size annotated so they can be re-enabled easily if needed in the future. * Restore scikit-learn -- needed by sentence_transformers sentence_transformers is installed with --no-deps in extras-no-deps.txt, so its sklearn dependency is not auto-resolved. Multiple modules in sentence_transformers import sklearn at the top level (evaluation, util/similarity), so removing scikit-learn would break embedding jobs.
56 lines
920 B
Text
56 lines
920 B
Text
# OpenEnv dependencies
|
|
tomli
|
|
tomli-w
|
|
|
|
# ExecuTorch dependencies
|
|
ruamel.yaml
|
|
# coremltools # 10.2 MB - Apple CoreML, no imports in unsloth/zoo/studio
|
|
expecttest
|
|
flatbuffers
|
|
hydra-core
|
|
hypothesis
|
|
kgb
|
|
parameterized
|
|
pytest<9.0
|
|
pytest-json-report
|
|
pytest-rerunfailures==15.1
|
|
pytest-xdist
|
|
# Also needed by sentence_transformers (installed with --no-deps in extras-no-deps.txt)
|
|
scikit-learn==1.7.1
|
|
|
|
# Additional extras
|
|
pybind11
|
|
langid
|
|
jiwer
|
|
omegaconf
|
|
einx
|
|
pyloudnorm
|
|
openai-whisper
|
|
# uroman # 4.0 MB - romanization, no imports found
|
|
# MeCab # 19.9 MB - Japanese tokenizer, no imports found
|
|
loguru
|
|
flatten_dict
|
|
ffmpy
|
|
randomname
|
|
argbind
|
|
tiktoken
|
|
ftfy
|
|
importlib-resources
|
|
librosa
|
|
markdown2
|
|
matplotlib
|
|
pystoi
|
|
soundfile
|
|
tensorboard
|
|
torch-stoi
|
|
evaluate
|
|
timm
|
|
transformers-cfg
|
|
open_spiel
|
|
addict
|
|
easydict
|
|
einops
|
|
tabulate
|
|
fastmcp>=3.0.2
|
|
openai>=2.7.2
|
|
websockets>=15.0.1
|