Improve local chat tool call flow (#5962)

Browse source

Unify the Studio local tool-call loop (GGUF + safetensors) behind a shared ToolLoopController: ordered preface-then-tool-card rendering, duplicate-call de-looping with a forced final answer, XML-leak containment, and a parser fix that accepts closed <function=...> calls followed by trailing prose. Includes backend tests for the controller, strict parser, and GGUF route cursor reset.

...

This commit is contained in:

Wasim Yousef Said 2026-06-09 16:28:44 +02:00 • committed by GitHub

parent 0d6d7dd4b3

commit ccb471f5bf

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

15 changed files with 3647 additions and 900 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1151

studio/backend/tests/test_llama_cpp_tool_loop.py Normal file

View file

File diff suppressed because it is too large Load diff