Addresses all P1 findings from reviewer round 3 (10 reviewers): 1. Revert disconnect check to every iteration (was every 20th). All 10 reviewers flagged this as a correctness regression for short streams and sparse tool event loops. The cancel watcher in llama_cpp.py is the primary mechanism but the route-layer check must remain per-iteration for completeness. [10/10] 2. Reset prev_text on tool_start in gguf_tool_stream. When a tool cycle begins after visible content was already streamed, the route-layer cumulative delta tracker (prev_text) must be reset so the post-tool synthesis response is not truncated or dropped. [9/10] 3. Remove the _last_emitted gate from the XML safety net. The gate was added to prevent retroactive tool execution after visible content, but with prev_text now reset on tool_start (#2), the root cause is fixed and the safety net can correctly handle content-then-tool-XML responses (matching pre-PR behavior). [8/10] |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_python_stack.py | ||
| LICENSE.AGPL-3.0 | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||