Roland Tannous 4eabc74f34 feat: subprocess-based inference for transformers version switching ... Inference now runs in a persistent subprocess, solving the same transformers version-switching problem that was fixed for training. The subprocess stays alive between requests (model in GPU memory) and is only restarted when switching transformers versions. New files: - core/inference/worker.py: subprocess entry point with command loop - core/inference/orchestrator.py: parent-side proxy with same API Modified: - core/inference/__init__.py: exports orchestrator as default backend - routes/inference.py: removed in-process ensure_transformers_version()		2026-03-05 17:47:57 +00:00
..
__init__.py	feat: subprocess-based inference for transformers version switching	2026-03-05 17:47:57 +00:00
inference.py	deleted duplicate definitions	2026-02-27 06:00:28 -08:00
llama_cpp.py	fix: align llama-server binary discovery with upstream unsloth-zoo paths	2026-03-03 17:03:01 +00:00
orchestrator.py	feat: subprocess-based inference for transformers version switching	2026-03-05 17:47:57 +00:00
worker.py	feat: subprocess-based inference for transformers version switching	2026-03-05 17:47:57 +00:00