- GGUF: use -c 0 for model's native context size (no 4096 cap) - GGUF: hide Max Seq Length slider (irrelevant), set Max Tokens to Max - Non-GGUF: default Max Tokens to 4096 - Max Tokens slider shows "Max" label when at ceiling for GGUFs - Run non-GGUF load_model in asyncio.to_thread for progress polling - Auto-load smallest downloaded model when chatting without selection - Wait for in-progress model load before inference (modelLoading store flag) - Recommended list: 4 GGUFs + 4 hub models after case-insensitive dedup - Model selector waits for cached data before rendering - Toast close button repositioned, Sampling section open by default - Add logging to _get_repo_size_cached exception handler |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| tests | ||
| utils | ||
| __init__.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||