unsloth/studio/backend/core/inference
Roland Tannous 5bd6fac80e fix: always spawn fresh subprocess per model load
Reusing a subprocess after unsloth patches torch internals causes
inspect.getsource() failures when loading a different model type.
Each load now gets a clean Python interpreter.
2026-03-05 19:15:37 +00:00
..
__init__.py feat: subprocess-based inference for transformers version switching 2026-03-05 17:47:57 +00:00
inference.py deleted duplicate definitions 2026-02-27 06:00:28 -08:00
llama_cpp.py fix: align llama-server binary discovery with upstream unsloth-zoo paths 2026-03-03 17:03:01 +00:00
orchestrator.py fix: always spawn fresh subprocess per model load 2026-03-05 19:15:37 +00:00
worker.py fix: use mp.Event for instant cross-process generation cancel 2026-03-05 18:54:17 +00:00