Daniel Han 1d289aab61 Studio diffusion (Phase 12): only engage FBCache on context-aware transformers; quantized threshold for GGUF ... - apply_step_cache now engages only via the transformer's native enable_cache (the diffusers CacheMixin path), which exists exactly when the pipeline wraps the transformer call in a cache_context. The standalone apply_first_block_cache fallback installed on non-CacheMixin transformers too (e.g. Z-Image), whose pipeline opens no cache_context, so the load reported transformer_cache=fbcache and then the first generation crashed inside the hook. Such a model now runs uncached per the best-effort contract. - GGUF transformers are quantized (the default Studio load path), so they now use the higher quantized FBCache threshold when the caller leaves it unset, instead of the dense default that could keep the cache from triggering. - fbcache_flux_probe.py: compile cached runs with fullgraph=False (FBCache is a graph break, so fullgraph=True failed warmup and silently measured an eager cached run); output dir is now relative to the script, not a hardcoded path.		2026-06-28 06:02:12 +00:00
..
__init__.py	Studio: make code comments and docstrings more succinct (#6029)	2026-06-08 23:07:28 -07:00
_html_to_md.py	Reduce and tighten code comments and docstrings repo-wide (#6095)	2026-06-08 23:09:51 -07:00
anthropic_compat.py	Studio: improve OpenAI- and Anthropic-compatible API spec compliance (#6010)	2026-06-09 17:13:25 +02:00
api_monitor.py	Studio: trim serving-log noise and surface llama-server engine stats (#6377)	2026-06-17 05:37:57 -07:00
audio_codecs.py	Reduce and tighten code comments and docstrings repo-wide (#6095)	2026-06-08 23:09:51 -07:00
chat_template_helpers.py	Studio: make code comments and docstrings more succinct (#6029)	2026-06-08 23:07:28 -07:00
chat_templates.py	Studio: bundle Gemma 4 chat templates (E2B/E4B + larger) and auto-apply to unsloth/gemma-4-*-GGUF (#6245)	2026-06-12 05:49:39 -07:00
defaults.py	Reduce and tighten code comments and docstrings repo-wide (#6095)	2026-06-08 23:09:51 -07:00
diffusion.py	Studio diffusion (Phase 12): only engage FBCache on context-aware transformers; quantized threshold for GGUF	2026-06-28 06:02:12 +00:00
diffusion_attention.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-26 12:03:36 +00:00
diffusion_cache.py	Studio diffusion (Phase 12): only engage FBCache on context-aware transformers; quantized threshold for GGUF	2026-06-28 06:02:12 +00:00
diffusion_device.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-25 11:30:41 +00:00
diffusion_families.py	Studio diffusion (Phase 9): pre-quantized transformer loading	2026-06-26 11:23:20 +00:00
diffusion_memory.py	Studio diffusion (Phase 7): accuracy-preserving speed pass	2026-06-26 03:18:44 +00:00
diffusion_precision.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-25 14:43:45 +00:00
diffusion_prequant.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-26 11:24:35 +00:00
diffusion_speed.py	Studio diffusion (Phase 12): First-Block-Cache step caching for many-step DiT	2026-06-26 12:35:50 +00:00
diffusion_transformer_quant.py	Studio diffusion (Phase 11): prefer int8 on consumer GPUs in the auto ladder	2026-06-26 12:09:16 +00:00
external_provider.py	Studio: ignore unsupported env proxy during Studio startup (#6102)	2026-06-11 05:13:27 -07:00
gpu_arbiter.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-25 03:21:55 +00:00
image_gallery.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-25 03:21:55 +00:00
inference.py	fix(studio): handle multimodal list content in inference text paths (#4383) (#6480)	2026-06-23 01:26:11 -07:00
key_exchange.py	Reduce and tighten code comments and docstrings repo-wide (#6095)	2026-06-08 23:09:51 -07:00
llama_cpp.py	Studio: honor stream=false on the GGUF agentic tool path (#6570) (#6618)	2026-06-24 15:37:08 +01:00
llama_http.py	Studio: serialize non-streaming responses once and pool the proxy client (#6393)	2026-06-17 22:38:02 -07:00
llama_server_args.py	studio: deterministic VRAM auto-fit for GGUF (MTP reserve, compute buffer, total-based budget) (#6312)	2026-06-17 03:10:22 -07:00
llama_stats.py	Studio: trim serving-log noise and surface llama-server engine stats (#6377)	2026-06-17 05:37:57 -07:00
mcp_client.py	Studio: enable stdio MCP servers on a loopback bind (#6295)	2026-06-15 03:02:32 +01:00
mcp_config_import.py	studio: show MCP "Import config" on the add-server form (#6030)	2026-06-11 16:17:22 +01:00
message_content.py	fix(studio): handle multimodal list content in inference text paths (#4383) (#6480)	2026-06-23 01:26:11 -07:00
mlx_inference.py	Expose runtime context length for hub models (#6154)	2026-06-11 22:13:53 +03:00
orchestrator.py	Studio: persistent per-user trust_remote_code approval cache (#6551)	2026-06-22 05:12:49 -07:00
pricing.py	Reduce and tighten code comments and docstrings repo-wide (#6095)	2026-06-08 23:09:51 -07:00
providers.py	Studio: Add custom provider option to Connections (#6112)	2026-06-12 13:09:35 +02:00
runtime_context.py	Expose runtime context length for hub models (#6154)	2026-06-11 22:13:53 +03:00
safetensors_agentic.py	Studio: show tool-call progress for large GGUF tool arguments (#6484)	2026-06-22 05:50:10 -07:00
sd_cpp_args.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-26 03:20:02 +00:00
sd_cpp_engine.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2026-06-26 03:20:02 +00:00
tensor_fallback.py	studio: deterministic VRAM auto-fit for GGUF (MTP reserve, compute buffer, total-based budget) (#6312)	2026-06-17 03:10:22 -07:00
tool_call_parser.py	Fix Gemma 4 GGUF OpenAI API streams (#6476)	2026-06-23 06:13:56 -07:00
tool_loop_controller.py	Studio: clean-room compact RAG (knowledge bases, hybrid search, fast indexing) (#5910)	2026-06-09 21:17:04 -07:00
tools.py	Use UTF-8 for Python code-execution subprocess I/O (#6489 class) (#6548)	2026-06-22 09:06:03 -07:00
worker.py	Generalize transformers tier selection by probing AutoConfig (#6550)	2026-06-22 08:20:06 -07:00