Roland Tannous 5cedd9a5b2 Fix httpcore asyncgen cleanup in /v1/messages and /v1/completions ... The earlier fix in 985e92a9 was incomplete: it closed aiter_lines() explicitly but still used `async with httpx.AsyncClient()` / `async with client.stream()` inside the generator. When the generator is orphaned (e.g. client disconnects mid-stream and Starlette drops the StreamingResponse iterator without explicitly calling aclose()), Python's asyncgen finalizer runs the cleanup in a DIFFERENT task than the one that originally entered the httpx context managers. The `async with` exits then trigger httpcore's HTTP11ConnectionByteStream .aclose(), which enters anyio.CancelScope.__exit__ with a mismatched task and raises RuntimeError("Attempted to exit cancel scope in a different task"). That error escapes any user-owned try/except because it happens during GC finalization. Replace `async with` with manual client/response lifecycle in both /v1/messages passthrough and /v1/completions proxy. Close the response and client in a finally block wrapped in `try: ... except Exception: pass`. This suppresses RuntimeError (and other Exception subclasses) from the anyio cleanup noise while letting GeneratorExit (a BaseException, not Exception) propagate cleanly so the generator terminates as Python expects. Traceback observed in user report: File ".../httpcore/_async/connection_pool.py", line 404, in __aiter__ yield part RuntimeError: async generator ignored GeneratorExit ... File ".../anyio/_backends/_asyncio.py", line 455, in __exit__ raise RuntimeError( RuntimeError: Attempted to exit cancel scope in a different task		2026-04-13 12:09:46 +04:00
..
backend	Fix httpcore asyncgen cleanup in /v1/messages and /v1/completions	2026-04-13 12:09:46 +04:00
frontend	Use actual origin in API key usage examples	2026-04-10 13:36:43 +00:00
__init__.py	Final cleanup	2026-03-12 18:28:04 +00:00
install_llama_prebuilt.py	Add AMD ROCm/HIP support across installer and hardware detection (#4720)	2026-04-10 01:56:12 -07:00
install_python_stack.py	Pin bitsandbytes to continuous-release_main on ROCm (4-bit decode fix) (#4954)	2026-04-10 06:25:39 -07:00
LICENSE.AGPL-3.0	Add AGPL-3.0 license to studio folder	2026-03-09 19:36:25 +00:00
setup.bat	Final cleanup	2026-03-12 18:28:04 +00:00
setup.ps1	split venv_t5 into tiered 5.3.0/5.5.0 and fix trust_remote_code (#4878)	2026-04-07 20:05:01 +04:00
setup.sh	Add AMD ROCm/HIP support across installer and hardware detection (#4720)	2026-04-10 01:56:12 -07:00
Unsloth_Studio_Colab.ipynb	Allow install_python_stack to run on Colab (#4633)	2026-03-27 00:29:27 +04:00