Raise the default parallel slot count so Studio chat and the external API endpoint can run concurrently without a subprocess restart. Enable/disable of the Access Endpoint is now instant — it only mints or clears the API key, since the parallel slots are already in place from the initial load. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| _html_to_md.py | ||
| audio_codecs.py | ||
| defaults.py | ||
| inference.py | ||
| llama_cpp.py | ||
| orchestrator.py | ||
| tools.py | ||
| worker.py | ||