4c70a9ed72
The IQ3_XXS quants the Linux smoke uses are pathological at
temperature=0 on Apple Silicon Metal:
- Qwen3.5-2B IQ3_XXS emits 'The The The...' for tool-call prompts
(no tool_calls in the response, hits max_tokens).
- gemma-4-E2B IQ3_XXS emits '<unused5><unused5>...' for any prompt
(model degenerates to padding tokens).
Both are inference-path-correct but quant-degenerate; the Linux CPU
backend hides the issue. Bump both to UD-Q4_K_XL, the smallest
published variant that generates real text + well-formed tool calls
on M1. Inference time goes up modestly (CI is cache-warm so download
cost is one-shot per HF release).
Also bump STUDIO_UI_TURN_TIMEOUT_MS to 540s for the Mac UI job:
the macos-14 free runner is 3-5x slower than ubuntu-latest at
gemma-3-270m CPU inference, and the existing 180s ceiling crowded
turn 4 ('say tree').
|
||
|---|---|---|
| .. | ||
| ISSUE_TEMPLATE | ||
| workflows | ||
| CODEOWNERS | ||
| dependabot.yml | ||
| FUNDING.yml | ||