Merge branch 'diffusion-auto-badges' into diffusion-more-families
This commit is contained in:
Daniel Han
commit
45fce770cc
173 changed files with 98 additions and 1517 deletions
5
.gitignore
vendored
5
.gitignore
vendored
|
|
@ -237,3 +237,8 @@ package-lock.json
|
|||
llama.cpp/
|
||||
# Stray "~" dir some tools create from a literal ~ TMPDIR; never part of the repo.
|
||||
/~/
|
||||
|
||||
# Agent workspace runtime/scratch artifacts, never part of the repo.
|
||||
async_task_outputs/
|
||||
temp/
|
||||
logs/
|
||||
|
|
|
|||
|
|
@ -1 +0,0 @@
|
|||
- Asked: `Make a new PR for that work`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- CI pending; local at `9c5b35c71`
|
||||
|
|
@ -1,4 +0,0 @@
|
|||
- Decision: GPU default stays PyTorch/diffusers; benchmark showed PyTorch GGUF 0.82s vs sd.cpp `--diffusion-fa` 6.96s at 1024px (~8.5x faster).
|
||||
- File noted: `scripts/compare_engines.py` reproduces benchmark; not committed in span.
|
||||
- Command `tail -30 ...compare_engines_*.log` showed run progress; background run completed exit 0.
|
||||
- COMPLETED: GPU comparison. PENDING: optional commit and CPU comparison.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Completed CPU sd.cpp vs diffusers benchmark.
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue cascading the already-pushed phase16 branch into the top branches, starting with image-workflows #6769 in the `unsloth` worktree; phase16 is merged but has unresolved conflicts. Next action is to inspect the conflict hunks in the listed files, especially `studio/backend/core/inference/diffusion.py`, `diffusion_families.py`, install tests, frontend picker/API/page files, and the truncated remaining paths from `git status`, then resolve them without re-running the completed merge command.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked summary for PR `6658`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `Transform` img2img done+verified.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PENDING: HF NVFP4 diffusion search
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PENDING: consumer GPU FP32 accum nerf; test 2:4 sparse
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Bench done; report/results written.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `Yes do that for all models as well`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `INT8`: use `Qwen/Qwen-Image`+torchAO
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Pending ComfyUI all-models/accuracy bench
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `9c5b35c71`; lint pass, CPU queued
|
||||
|
|
@ -1,15 +0,0 @@
|
|||
- Decision: PR `#6658` (`https://github.com/unslothai/unsloth/pull/6658`) was identified as the base PR because `gh pr view 6658 --repo unslothai/unsloth --json number,title,author,headRefName,baseRefName,state,url` showed head `image-generation`, base `main`, author `oobabooga`, state `OPEN`, title `Studio: add image generation with Unsloth GGUFs`.
|
||||
- Decision: The full diffusion stack was treated as 14 PRs total: original `#6658` plus 13 phase PRs. Reason: the branch chain was contiguous, each PR base matched the prior PR head; phases `3`, `5`, and `13` had no standalone PR and were folded into adjacent PRs.
|
||||
- Decision: Posted `@codex review` and `/gemini review` as separate comments on every PR so one bot trigger would not swallow the other.
|
||||
- Commands run: `gh auth status 2>&1 | head -20` exited successfully; key output showed authenticated to `github.com` as `danielhanchen` using `GH_TOKEN`.
|
||||
- Commands run: `cd /tmp && gh pr view 6658 --repo unslothai/unsloth --json number,title,author,headRefName,baseRefName,state,url 2>&1 | head -40` exited successfully; key output confirmed PR `#6658` metadata.
|
||||
- Commands run: `cd /tmp && gh pr list --repo unslothai/unsloth --author danielhanchen --state all --limit 60 --json number,title,headRefName,baseRefName,state,createdAt 2>&1 | head -200` exited successfully and was used to identify authored phase PRs.
|
||||
- Commands run: loop posted comments to `PRS="6658 6670 6675 6679 6680 6690 6694 6700 6701 6702 6703 6716 6717 6724"` using `gh pr comment "$n" --repo unslothai/unsloth --body "@codex review"` and `gh pr comment "$n" --repo unslothai/unsloth --body "/gemini review"`.
|
||||
- Command result: all 28 comment posts succeeded with `codex_rc=0` and `gemini_rc=0`.
|
||||
- PR stack recorded: `#6658` branch `image-generation` base `main`; `#6670` branch `diffusion-phase1` base `pr6658-image-generation`; `#6675` branch `diffusion-phase2-memory` base `diffusion-phase1`; `#6679` branch `diffusion-phase4-native` base `diffusion-phase2-memory`; `#6680` branch `diffusion-phase6-features` base `diffusion-phase4-native`; `#6690` branch `diffusion-phase7-perf` base `diffusion-phase6-features`; `#6694` branch `diffusion-phase8-quant` base `diffusion-phase7-perf`; `#6700` branch `diffusion-phase9-prequant` base `diffusion-phase8-quant`; `#6701` branch `diffusion-phase10-attention` base `diffusion-phase9-prequant`; `#6702` branch `diffusion-phase11-consumer-int8` base `diffusion-phase10-attention`; `#6703` branch `diffusion-phase12-fbcache` base `diffusion-phase11-consumer-int8`; `#6716` branch `diffusion-phase14-int8-modulation` base `diffusion-phase12-fbcache`; `#6717` branch `diffusion-phase15-int8-prequant` base `diffusion-phase14-int8-modulation`; `#6724` branch `diffusion-phase16-native-engine-routing` base `diffusion-phase15-int8-prequant`.
|
||||
- Comment URLs captured for `#6658`: codex `https://github.com/unslothai/unsloth/pull/6658#issuecomment-4828987610`, gemini `https://github.com/unslothai/unsloth/pull/6658#issuecomment-4828987681`.
|
||||
- Comment URLs captured for `#6670`: codex `https://github.com/unslothai/unsloth/pull/6670#issuecomment-4828987748`, gemini `https://github.com/unslothai/unsloth/pull/6670#issuecomment-4828987824`.
|
||||
- Error encountered: shell cwd was reset to `/mnt/disks/unslothai/ubuntu/workspace_81` after `cd /tmp`; no unresolved impact reported.
|
||||
- Files created/edited: none.
|
||||
- COMPLETED: authenticated GitHub context checked, full PR stack identified, `@codex review` and `/gemini review` posted separately on all 14 PRs.
|
||||
- PENDING: none for this span.
|
||||
|
|
@ -1,2 +0,0 @@
|
|||
- Done: diffusion; 73 pass
|
||||
- Pending PR
|
||||
|
|
@ -1 +0,0 @@
|
|||
- GPU: ours beats ComfyUI; pending Z/Flux2
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked support: `Mac`, GPU, GGUF
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Wrote `outputs/coverage_matrix.md`
|
||||
|
|
@ -1,12 +0,0 @@
|
|||
- Decision: removed Studio diffusion weight-buffer feature because allocator already pools per-forward casts with no `cudaMalloc` churn, so end-to-end impact was neutral; left upstream LLM `WEIGHT_BUFFERS` in `unsloth/kernels/utils.py` untouched because unrelated reference path.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion_gguf_compile.py`: removed `_WEIGHT_BUFFERS`, `_weight_buffer`, `_buffered_forward_native`, `install_weight_buffer`, `uninstall_weight_buffer`, `is_weight_buffer_installed`, env flag; docstring now explains removal.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion_speed.py`: removed `"weight_buffer"` flag and install block; docstrings clarify eager has no GGUF accelerator.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion.py`: removed buffer comments; `uninstall_all()` only reverts compiled-dequant.
|
||||
- Edited tests: removed 6 weight-buffer tests; updated `test_speed_eager_gguf_installs_no_accelerator`; `_stub_gguf_accel` now records compiled-dequant only.
|
||||
- Deleted `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/buffer_bench.py`.
|
||||
- Ran `grep -rn -i "weight_buffer\|buffered_forward\|install_weight_buffer\|WEIGHT_BUFFERS\|_buffered_forward_native\|is_weight_buffer" --include="*.py" studio/`; key output: no hits.
|
||||
- Ran `CUDA_VISIBLE_DEVICES="" python -m pytest tests/test_diffusion_speed.py tests/test_diffusion_gguf_compile.py tests/test_diffusion_arch_patches.py -q`; result `28 passed in 7.84s`.
|
||||
- Ran `CUDA_VISIBLE_DEVICES="" python -m pytest tests/ -q -k "diffusion"`; result `294 passed, 1 skipped, 5012 deselected, 1 warning in 13.38s`.
|
||||
- Ran tree-wide grep for removed symbols; only remaining hits are `WEIGHT_BUFFERS` in `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/unsloth/kernels/utils.py`, intentionally not changed.
|
||||
- COMPLETED: Studio diffusion global-buffer removal and verification.
|
||||
- PENDING: none in this span.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Done: PR `#6690` opened, mergeable
|
||||
|
|
@ -1,2 +0,0 @@
|
|||
- PENDING: Verify from `conversation history jsonl` whether CPU `sd.cpp` is fastest vs alternatives including `ComfyUI`; if confirmed, wire it into studio when GPUs are absent.
|
||||
- PENDING: Check and benchmark `https://github.com/sgl-project/sglang-omni`, `https://docs.sglang.io/docs/sglang-diffusion/index`, `https://docs.nvidia.com/dynamo/dev/backends/sg-lang/diffusion`, `https://developer.nvidia.com/blog/accelerating-diffusion-models-with-an-open-plug-and-play-offering/`, `https://github.com/NVlabs/FastGen`, `https://github.com/vllm-project/vllm-omni`.
|
||||
|
|
@ -1,2 +0,0 @@
|
|||
- #149 done: suite+5 GIFs pass
|
||||
- #148 hardened; #152 blocked
|
||||
|
|
@ -1 +0,0 @@
|
|||
- User challenged comparison: check `ComfyUI` with `int8 / float8 / NVFP4` and compare BEST ComfyUI with all optimizations on.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked GGUF/diffusers CPU speed
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked int8 pre-quant support
|
||||
|
|
@ -1,5 +0,0 @@
|
|||
- Verified all phase PRs touch only `studio/backend/...` plus `scripts/`; no core training lib.
|
||||
- Found GGUF NVIDIA path defaults to `SPEED_OFF` field but `resolve_speed_mode(..., is_gguf=True)` enables ~2.2x.
|
||||
- Confirmed `SdCppEngine` not wired into live routes.
|
||||
- COMPLETED: precise speedup matrix.
|
||||
- PENDING: route CPU/MPS to sd.cpp.
|
||||
|
|
@ -1,2 +0,0 @@
|
|||
- Completed: sd.cpp CUDA works; diffusers GPU 10-16x faster; beats ComfyUI 3.9-7.9x on FLUX.1/Qwen.
|
||||
- Pending: Z-Image, FLUX.2-klein, LPIPS accuracy, CPU ComfyUI-vs-sd.cpp.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Studio live; stale install fixed
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue the latest actionable directive: fully satisfy the stop-hook goal by completing fair best-vs-best coverage for “as many models as possible,” especially Z-Image and FLUX.2-klein fp8 ComfyUI comparisons that were still pending. sd.cpp GPU support, sd.cpp-vs-diffusers performance, diffusers-vs-ComfyUI on tested models, accuracy validation, and CPU/GPU sd.cpp coverage were already marked done. The last assistant tool action, writing `outputs/coverage_matrix.md`, is done; next logically continue by fetching/running the missing fp8 best ComfyUI benchmarks for Z-Image and FLUX.2-klein, then update the coverage/writeup with those results.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked overall speedup.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked Studio `--secure`+PRs
|
||||
|
|
@ -1,2 +0,0 @@
|
|||
- Done: `sd.cpp` CUDA
|
||||
- Pending: accuracy, ComfyUI, CPU
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue the latest directive: verify which earlier-phase review comments are real and still unfixed, fix real issues on their owning stacked branches, and skip ones already fixed by later phases. Phase 16/#6724 is done and pushed; task 88 is in progress. The next concrete action is to continue from the completed checkout of `diffusion-phase9-prequant` and implement the planned safe fix for the #6700 `torch.load(weights_only=False)` RCE in the prequant local-path load path, then test, commit, and push that branch.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- 2A/2B/2D/3/5 done; `b7074ad05`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- TODO: reconcile CI PR `#6717`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Bench done; summary/result files written
|
||||
|
|
@ -1,9 +0,0 @@
|
|||
- Decision: hook feedback says task is not fully satisfied because best-vs-best ComfyUI fp8 coverage is incomplete for all tested model families.
|
||||
- Decision: confirmed completed items include `sd.cpp` GPU support, CUDA build for `sm_100`, working CPU/GPU paths, sd.cpp vs diffusers comparisons, diffusers+opts beating ComfyUI for tested best-vs-best cases, and LPIPS accuracy staying within the 25% rule with no 50% loss.
|
||||
- Decision: performance conclusions preserved: optimized diffusers is `1.9-3.4x` faster on GPU than optimized `sd.cpp`; `sd.cpp` is `1.6-2.8x` faster on CPU; diffusers+opts beats ComfyUI best-vs-best `1.9-3.4x` on GPU for FLUX.1 and Qwen.
|
||||
- Pending gap: `test as many models as possible` remains incomplete; only 2 of 4 model families have full best-vs-best ComfyUI fp8 comparisons: `FLUX.1` and `Qwen-Image`.
|
||||
- Pending gap: `Z-Image` and `FLUX.2-klein` currently have only ComfyUI GGUF comparison numbers, not ComfyUI fp8 best numbers.
|
||||
- Verbatim unresolved statement to preserve: `For Z-Image and FLUX.2-klein I only have the ComfyUI **GGUF** numbers so far (2.51s, 1.01s) vs our 0.51s/0.27s — I can fetch their fp8 single-files and rerun those two best-vs-best to fully close it.`
|
||||
- Key output: ComfyUI GGUF numbers for `Z-Image` and `FLUX.2-klein` are `2.51s` and `1.01s`; current “our” numbers are `0.51s/0.27s`.
|
||||
- Completed: most sd.cpp/diffusers optimization, CPU/GPU, performance, and accuracy validation work.
|
||||
- Pending: fetch fp8 single-files for `Z-Image` and `FLUX.2-klein`, rerun ComfyUI fp8 best-vs-best, compare against optimized diffusers/sd.cpp, and update final conclusion.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- GGUF=diffusers+PyTorch; sd.cpp likely fasterCPU
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PENDING: PR 6658 int8/fp8 mem
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Run `gh pr checks 6717`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- User directed: `keep working`; continue pending review/work.
|
||||
|
|
@ -1,17 +0,0 @@
|
|||
- Decision: Used live GitHub PR metadata rather than memory to reconstruct the PR stack accurately.
|
||||
- Decision: Treated closed `#6658` as the original image-generation root and open `#6763` as the live continuation, because both are by `oobabooga`, both use head branch `image-generation`, and both are based on `main`.
|
||||
- Decision: Identified all authored PRs by `danielhanchen` stacked transitively on `#6658` / `#6763`, with current work concentrated in the top diffusion-image-workflows sub-stack.
|
||||
- Commands run from `/mnt/disks/unslothai/ubuntu/workspace_81`:
|
||||
- `env -u GH_TOKEN gh pr list --repo unslothai/unsloth --author danielhanchen --state open --limit 50 --json number,title,headRefName,baseRefName,isDraft,state 2>&1 | head -100`
|
||||
- Key output included open authored PRs such as `#6781` head `fix-mlx-gguf-reload-context` base `main`, title `MLX CI: bound llama-cli context so the GGUF reload stops timing out`; `#6780` head `fix-rag-extraction-rtl-docx-tables` base `main`, title `Studio RAG: fix RTL/Indic PDF corruption and dropped DOCX tables`; output was truncated after `harden-llmco`.
|
||||
- `for n in 6658 6763; do ... env -u GH_TOKEN gh pr view $n --repo unslothai/unsloth --json number,title,headRefName,baseRefName,author,state ... done`
|
||||
- Key output: `#6658 [CLOSED] by oobabooga`, title `Studio: add image generation with Unsloth GGUFs`, head `image-generation`, base `main`.
|
||||
- Key output: `#6763 [OPEN] by oobabooga`, title `Studio: add image generation with Unsloth GGUFs`, head `image-generation`, base `main`.
|
||||
- No files were created or edited in this span.
|
||||
- No errors were encountered.
|
||||
- Completed: Produced bottom-to-top stack rooted at `#6658` / `#6763`: `main` → `image-generation` `#6763` / `#6658` → `#6679` `diffusion-phase4-native` → `#6680` `diffusion-phase6-features` → `#6690` `diffusion-phase7-perf` → `#6694` `diffusion-phase8-quant` → `#6700` `diffusion-phase9-prequant` → `#6701` `diffusion-phase10-attention` → `#6702` `diffusion-phase11-consumer-int8` → `#6703` `diffusion-phase12-fbcache` → `#6716` `diffusion-phase14-int8-modulation` → `#6717` `diffusion-phase15-int8-prequant` → `#6724` `diffusion-phase16-native-engine-routing`, branching to `#6768` `diffusion-sdserver` and `#6769` `diffusion-image-workflows`; from `#6769`, branches `#6772` `diffusion-fp8-perrow` and `#6771` `diffusion-lora` → `#6773` `diffusion-controlnet`.
|
||||
- Completed: Counted `16 PRs`, all authored by `danielhanchen`, all currently `OPEN`, transitively stacked on `#6658` / `#6763`.
|
||||
- Completed: Grouped stack as `Phase chain (11): #6679, #6680, #6690, #6694, #6700, #6701, #6702, #6703, #6716, #6717, #6724`; `Native sd-server branch (1): #6768`; `diffusion-image-workflows sub-stack (4): #6769 -> #6771, #6772 -> #6773`.
|
||||
- Completed: Noted session work landed in top PRs `#6769`, `#6771`, `#6772`, `#6773`, covering `On Device/chat picker fixes`, `GGUF speed-mode relabel`, `LoRA dot-alias fix`, `FP8 per-row fix`, `ControlNet`, and `FLUX.2-dev family`.
|
||||
- Completed: Flagged that phase numbers `5` and `13` are absent as separate open PRs because they were folded into adjacent phases upstream.
|
||||
- Pending: User was offered follow-up to list merge order or check CI status across the stack; no follow-up was performed in this span.
|
||||
|
|
@ -1,7 +0,0 @@
|
|||
- User directed continuation with `Yes do phase 16`.
|
||||
- Decision: proceed to `phase 16` because the user explicitly approved it.
|
||||
- Files created/edited: none in this span.
|
||||
- Commands run: none in this span.
|
||||
- Errors encountered: none.
|
||||
- COMPLETED: captured user approval for `phase 16`.
|
||||
- PENDING: execute `phase 16` in the resumed session.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- check PR 6658 int8/fp8 mem
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `keep testing`; continue phases
|
||||
|
|
@ -1,15 +0,0 @@
|
|||
- Decision: stacked Phase 16 on `diffusion-phase15-int8-prequant` because current workspace HEAD was Phase 15 (`9c5b35c71`) and PR needed to continue the chain.
|
||||
- Decision: staged only the 11 intended feature/test files and deliberately excluded local benchmark tooling/logs/plans to keep PR scope clean.
|
||||
- Created branch `diffusion-phase16-native-engine-routing` from `diffusion-phase15-int8-prequant`.
|
||||
- Committed `7f3c206fa` with message `Studio diffusion (Phase 16): route no-GPU loads to the native sd.cpp engine`.
|
||||
- Files committed: `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/diffusion_engine_router.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/diffusion_families.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/gpu_arbiter.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/sd_cpp_backend.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/sd_cpp_engine.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/models/inference.py`, `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/routes/inference.py`, plus 4 test files including `studio/backend/tests/test_diffusion_engine_router.py` and `studio/backend/tests/test_sd_cpp_backend.py`.
|
||||
- Created PR body file `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/temp/phase16_pr_body.md`.
|
||||
- Ran `gh auth status`; key output: logged in to `github.com` as `danielhanchen` using `GH_TOKEN`.
|
||||
- Ran `git checkout -b diffusion-phase16-native-engine-routing`; exit success, output `Switched to a new branch 'diffusion-phase16-native-engine-routing'`.
|
||||
- Ran `git commit`; exit success, output `11 files changed, 1241 insertions(+), 27 deletions(-)`, created 4 new files.
|
||||
- Ran `git push -u origin diffusion-phase16-native-engine-routing`; exit success, branch pushed to `https://github.com/unslothai/unsloth.git`; remote noted `GitHub found 19 vulnerabilities on unslothai/unsloth's default branch`.
|
||||
- Ran `gh pr create --repo unslothai/unsloth --base diffusion-phase15-int8-prequant --head diffusion-phase16-native-engine-routing --title "Studio diffusion (Phase 16): route no-GPU loads to the native sd.cpp engine" --body-file temp/phase16_pr_body.md`; output warning `Warning: 20 uncommitted changes`, then created `https://github.com/unslothai/unsloth/pull/6724`.
|
||||
- Ran `gh pr view 6724 --repo unslothai/unsloth --json number,title,state,baseRefName,headRefName,additions,deletions,changedFiles,url`; verified PR `#6724` is `OPEN`, base `diffusion-phase15-int8-prequant`, head `diffusion-phase16-native-engine-routing`, `+1241/-27 across 11 files`.
|
||||
- Completed: Phase 16 PR created and verified at `https://github.com/unslothai/unsloth/pull/6724`.
|
||||
- Completed: summary noted prior validation: sd.cpp fastest CPU engine vs diffusers/ComfyUI; CPU/Mac Studio auto-routes to sd.cpp with diffusers fallback; `313 tests green + real CPU end-to-end validated`; external comparisons written in `outputs/ext_engines/SUMMARY.md`, `FINAL_engine_comparison.md`, and `coverage_matrix.md`.
|
||||
- Pending: CI on PR `#6724` still needs to run/be watched; user was asked whether to watch checks and reconcile failures.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR #6716 int8 fix done; CI pending
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Created `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/compare_engines.py`; started GPU6 benchmark; wait/read rejected.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `INT8` uses `Qwen/Qwen-Image` torchAO
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked if full platform/model opt done
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Check int8 failures; fix if possible
|
||||
|
|
@ -1 +0,0 @@
|
|||
- img2img done; pending frontend Transform
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Extend done; live URL `https://pierre-airlines-barbie-continues.trycloudflare.com`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Need faster inference; use 5 Opus
|
||||
|
|
@ -1 +0,0 @@
|
|||
- `Yes do that for all models as well`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Pending: compare `sd` vs PyTorch
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR `#6717` made; CI pending.
|
||||
|
|
@ -1,3 +0,0 @@
|
|||
- User requested: `Relaunch Studio with all changes and PRs`
|
||||
- No decisions, file edits, commands, or errors in this span.
|
||||
- PENDING: relaunch Studio reflecting all changes and PRs.
|
||||
|
|
@ -1 +0,0 @@
|
|||
• Asked GGUF backend: PyTorch vs cpp
|
||||
|
|
@ -1 +0,0 @@
|
|||
Resume the latest directive: say "Continue work" and resume the current diffusion safetensors implementation task because the /goal is not yet achieved or there was an API interruption. No tool call is in flight; continue from the prepared state where the stacked-PR plan is complete, the live deployment and verification are done, and the remaining work is to move the diffusion safetensors implementation forward while keeping the unrelated pre-existing speed-work files separate.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Relaunch Studio `--secure` stacked
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR `#6670` created stacked on `#6658`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Pending: coverage final reply
|
||||
|
|
@ -1 +0,0 @@
|
|||
- phase4/6 PRs merged: `#6679` `#6680`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR `#6690` merged? no; open/mergeable
|
||||
|
|
@ -1,4 +0,0 @@
|
|||
- User raised a pending concern: accuracy/safety of using `fast accumulation`, specifically whether overflow could cause issues.
|
||||
- No decisions, file edits, commands, or errors occurred in this span.
|
||||
- COMPLETED: captured the new review question.
|
||||
- PENDING: answer/analyze overflow risk and accuracy implications of `fast accumulation`.
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue work per the latest directive: if the /goal is not yet achieved or there was an API error, resume the current diffusion safetensors implementation task. The latest assistant state has no in-flight tool call; the next concrete action is to inspect the current repo/git state and continue from the existing diffusion safetensors work without re-running completed verification or PR-planning tools.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Fixed int8 M=1; PR `#6716`
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue from the latest user question: answer whether NXFP4/NVFP4 is supported through PyTorch core and TorchAO, based on the completed probe and PR updates. The in-flight work is complete: NVFP4 probe was measured, committed, pushed, PR body updated, and PR #6694 verified OPEN/MERGEABLE with sync 0/0. Next action is to provide the final concise answer: PyTorch core has FP4 primitives but no turnkey quantization flow; TorchAO supports NVFP4, but in this environment torch 2.9 only works with `use_triton_kernel=False` as a slow bf16-rate path, while the fast path needs MSLK or torch >= 2.11 CUTLASS FP4 extensions.
|
||||
|
|
@ -1,23 +0,0 @@
|
|||
- Decision: shipped compile path uses `transformer.compile_repeated_blocks(fullgraph = True, dynamic = True)`, which forwards to `torch.compile`; effective settings are `fullgraph=True`, `dynamic=True`, and default `mode`. This was chosen because Studio can vary resolution/batch/steps without excessive recompiles.
|
||||
- Decision: CUDA graphs are not enabled in the shipped path. Per `https://docs.pytorch.org/docs/stable/generated/torch.compile.html`, CUDA graphs come from `mode="reduce-overhead"` or `mode="max-autotune"`, while default mode gives Inductor fusion without graph capture.
|
||||
- Decision: `dynamic=True` conflicts with CUDA graphs because graph capture expects static shapes. Switching to CUDA graphs would require `dynamic=False` and recompilation for new shapes.
|
||||
- Decision: after ablation, `default` mode + `dynamic=True` remained the correct shipped choice because it was essentially as fast as autotune, much faster to compile, robust to shape changes, and avoided CUDA-graph runtime crashes.
|
||||
- Decision: `max-autotune-no-cudagraphs` worked but was not worth enabling as default: `0.78 s` vs `0.80 s` was within run-to-run noise, while compile time increased from `5.7 s` to `66.2 s` and required `dynamic=False`.
|
||||
- Decision: CUDA graph modes were rejected because they crashed in this pipeline, not merely because they were theoretically fragile.
|
||||
- Clarification made: since `fullgraph=True` succeeds, there is no Dynamo graph break in the block; GGUF dequant is compile-traceable. The remaining inefficiency is Inductor declining codegen for Z-Image complex-valued ops: `"does not support code generation for complex operators"`.
|
||||
- File context mentioned but not edited in this span: `diffusion_speed.py` contains the shipped compile call.
|
||||
- File context mentioned but not edited in this span: `compile_probe.py` already has a `--mode` flag and was used for mode ablation.
|
||||
- Command run: `LOG=logs/compile_modes_$(date +%Y%m%d_%H%M%S).log; echo "COMPILE MODES LOG: $LOG"; { for spec in "default:--mode default --dynamic" "maxautotune-nocg:--mode max-autotune-no-cudagraphs" "reduce-overhead:--mode reduce-overhead" "max-autotune:--mode max-autotune"; do ...` to ablate torch compile modes including CUDA graphs on GPU 6.
|
||||
- Command status: background task `b01iys6fy` completed with exit code `0`.
|
||||
- Command output file: `/home/ubuntu/CLAUDE_CODE_TMPDIR/claude-1000/-mnt-disks-unslothai-ubuntu-workspace-81/8723b9e3-2ab1-49e9-a4b1-d030954eb94a/tasks/b01iys6fy.output`.
|
||||
- Command run: `cat "$(ls -t /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/logs/compile_modes_*.log | head -1)"` to read the latest compile-mode ablation log.
|
||||
- Key result: `default` with `--mode default --dynamic` gave eager `1.82s/gen`, compiled `0.80s/gen`, `+56.3% vs eager`, PSNR `37.7 dB`, compile time `5.7s`, verdict `COMPILE-WORKS FASTER`.
|
||||
- Key result: `max-autotune-no-cudagraphs` with `dynamic=False` gave eager `1.83s/gen`, compiled `0.78 s`, `+57.2%`, PSNR `37.3 dB`, compile time `66.2 s`, and worked.
|
||||
- Key result: `reduce-overhead` with CUDA graphs and `dynamic=False` failed.
|
||||
- Key result: `max-autotune` with CUDA graphs and `dynamic=False` failed.
|
||||
- Error encountered: both CUDA graph modes raised `RuntimeError: accessing tensor output of CUDAGraphs that has been overwritten by a subsequent run` at `transformer_z_image.py:271, in forward`.
|
||||
- Error analysis: likely caused by regional compile plus CUDA graph output buffer reuse; denoiser calls the same compiled block repeatedly and Z-Image carries an output across calls, so the static CUDA graph output buffer is overwritten before a later read.
|
||||
- Error resolution: resolved by keeping CUDA graphs disabled; no code changes were made to try manual `cudagraph_mark_step_begin()` or output cloning.
|
||||
- Completed: answered why CUDA graphs were not being used and measured `default`, `max-autotune-no-cudagraphs`, `reduce-overhead`, and `max-autotune`.
|
||||
- Completed: reported mode-by-mode speed, PSNR, compile time, and failure status.
|
||||
- Pending: optional follow-up offered to wire `mode="max-autotune-no-cudagraphs"` into the opt-in `max` tier as a gated one-line change, leaving default unchanged.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Bench complete; `SUMMARY.md` written.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Fixed #197; LoRA E2E PASS; pending #195,#196,#185 subitems
|
||||
|
|
@ -1,11 +0,0 @@
|
|||
- Decision: served `wt-allprs` because branch `diffusion-all-prs` integrates stacked PRs `#6769`, `#6771`, `#6772`, `#6773` plus fixes including `e21700031`; verified HEAD is `929b8d8b3` with clean tree.
|
||||
- Decision: rebuilt frontend dist before relaunch so latest frontend commits were baked in.
|
||||
- Files changed: frontend build output regenerated under `/mnt/disks/unslothai/ubuntu/workspace_81/wt-allprs/studio/frontend/dist`, key asset `dist/assets/images--i_whlNR.js`.
|
||||
- Commands run: in `/mnt/disks/unslothai/ubuntu/workspace_81/wt-allprs`, `git branch --show-current`, `git status --porcelain`, `git log --oneline -12`; key output `diffusion-all-prs`, clean relevant status, HEAD log includes `929b8d8b3`.
|
||||
- Commands run: in `/mnt/disks/unslothai/ubuntu/workspace_81/wt-allprs/studio/frontend`, `npx vite build`; exit `0`, output `✓ built in 1.95s`.
|
||||
- Commands run: killed old `run.py --host 127.0.0.1 --port 8898` and `cloudflared`; command exit `144`, noted as `SIGURG` artifact, kill succeeded.
|
||||
- Commands run: curl readiness on `http://127.0.0.1:8898/`; before relaunch `000down`, after relaunch `200` after about `10s`.
|
||||
- Relaunched backend from `/mnt/disks/unslothai/ubuntu/workspace_81/wt-allprs/studio/backend`; log `/mnt/disks/unslothai/ubuntu/workspace_81/logs/studio_relaunch_20260701_102325.log`.
|
||||
- Verified tunnel `https://whenever-satisfaction-advertising-sunny.trycloudflare.com`; single listener on `:8898`.
|
||||
- Verified auth with `unsloth` / `diffusion-Thrg7s3tr1-UoGYq`; `login OK`, token len `127`, LoRA and ControlNet endpoints `200`, image backend `loaded = False`.
|
||||
- COMPLETED: Studio relaunched and ready with all stacked diffusion changes plus session fixes. PENDING: user testing, then next item likely SDXL or LoRA catalog.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- GGUF GPU=diffusers; CPU/MPS=sd.cpp
|
||||
|
|
@ -1,10 +0,0 @@
|
|||
- Decision: added **FLUX.1-Kontext-dev** because `FluxKontextPipeline` supports image+prompt editing, gated base was accessible, and `Q4_K_M` GGUF exists.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/diffusion_families.py`: added `flux-kontext` family with `FluxKontextPipeline`, `FluxTransformer2DModel`, base `black-forest-labs/FLUX.1-Kontext-dev`, `cfg_kwarg=guidance_scale`, edit workflow.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/frontend/src/features/images/images-page.tsx`: added Kontext Edit GGUF entry, supported keyword, gen default.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/frontend/src/components/assistant-ui/model-selector/pickers.tsx`: unhid Kontext picker.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/tests/test_diffusion_backend.py`: updated detect_family expectations for Kontext support.
|
||||
- Created `/mnt/disks/unslothai/ubuntu/workspace_81/scripts/repro_kontext_inprocess.py` and `/mnt/disks/unslothai/ubuntu/workspace_81/scripts/verify_kontext_http.py`.
|
||||
- Commands: backend tests/build passed: `78 passed, 5 warnings`, `tsc=0`, `BUILD=0`; HTTP verify passed: `family: flux.1-kontext`, `kind: gguf`, `workflows: ['edit']`, `PASS`, `=== EXIT 0 ===`.
|
||||
- Error: inline HTTP verify failed with `/bin/bash: eval: line 68: syntax error: unexpected end of file`; resolved by writing clean script.
|
||||
- Deployed Studio at `https://influences-qualification-thesis-loop.trycloudflare.com`.
|
||||
- Completed: task `#154` done, FLUX Kontext live and verified. Pending: `#152` mirror/macOS/Windows and committing stacked PRs.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Goal set: Studio image UI PR stack
|
||||
|
|
@ -1 +0,0 @@
|
|||
- CPU bench done; sd.cpp wins RAM/speed
|
||||
|
|
@ -1,7 +0,0 @@
|
|||
- User requested adding a dynamic check to distinguish consumer vs non-consumer GPUs, enabling the target behavior only for consumer GPUs.
|
||||
- Preserve requirement verbatim: `Add a dynamic check to check if consumer vs non consumer - so enable it only if consumer - see https://developer.nvidia.com/cuda/gpus for example`
|
||||
- Reference URL provided: `https://developer.nvidia.com/cuda/gpus`
|
||||
- No files edited in this span.
|
||||
- No commands run in this span.
|
||||
- COMPLETED: captured the new requirement.
|
||||
- PENDING: implement and verify the dynamic consumer GPU check.
|
||||
|
|
@ -1,5 +0,0 @@
|
|||
- Built `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/accuracy_lpips.py`; LPIPS vs bf16 satisfied 25/50% rule.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/comfy_bench.py` for `flux.2-klein,z-image`.
|
||||
- Created `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/outputs/FINAL_engine_comparison.md`.
|
||||
- Key results: ours GPU beats ComfyUI 3.8-7.9x; CPU `sd.cpp` 60.3s vs diffusers 98.5s vs ComfyUI 102.4s.
|
||||
- Errors: `/dev/null` and `/tmp/oi.json` blocked by sandbox; resolved with workspace paths. `pkill` exited 144 but confirmed `comfy procs: 0`.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Need use `5 Opus subagents` on URLs.
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue the research + implementation task: synthesize the 5 agents’ findings, the user’s speed-vs-quality tradeoff preference, and the empirical GPU probe results into concrete recommendations for Unsloth Studio diffusion performance/memory work. The `max`-tier compile-mode change, tests, commit, rebase, and push are already done; do not rerun those completed steps. Next action is to write the final synthesis/report, including that speed tests passed, the full selected suite passed, the branch was pushed, coordinate_descent_tuning was only ~2% faster, and FirstBlockCache failed on Z-Image in this stack.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Pushed `ede94176f`; PR `#6690` green.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Pending: apply UI label/warning change?
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Done: NVFP4 2C PR `dbb029256`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- GPU: diffusers; CPU/MPS: sd.cpp
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Built fast-transformer quant mode.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Goal: benchmark `sd.cpp` vs ComfyUI
|
||||
|
|
@ -1,19 +0,0 @@
|
|||
- Decision: Stacked PR prep was advanced without committing/pushing because outward-facing actions need user authorization; the plan is grounded in current git state.
|
||||
- Decision: Existing uncommitted speed-related changes must be kept separate from the feature work because they appear pre-existing and unrelated to this session.
|
||||
- Created `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/plans/diffusion-workflows-pr-plan.md`: added a stacked PR breakdown for work on branch `diffusion-eager-and-compile-cache`, including PR titles, summaries, file lists, and pre-PR test/build gates.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/plans/diffusion-workflows-pr-plan.md`: removed a stray tag after initial creation.
|
||||
- Proposed stack in the plan:
|
||||
1. Backend PR: safetensors kinds, image-conditioned workflows (`img2img`/inpaint/outpaint), instruction-editing families (`Qwen-Image-Edit`, `FLUX Kontext`), and two bug fixes.
|
||||
2. Frontend PR: workflow-tab Images redesign, mask canvas, outpaint, Edit tab, Advanced Options, and spinner fix.
|
||||
3. sd.cpp installer hardening PR: independent pin, `sha256`, mirror-ready installer changes.
|
||||
- Command run: `cd /mnt/disks/unslothai/ubuntu/workspace_81/unsloth 2>/dev/null || { echo "no unsloth repo"; exit 0; }; git branch --show-current; git remote -v | head -2; git log --oneline -8` exited successfully.
|
||||
- Key output: current branch `diffusion-eager-and-compile-cache`; remote `oobabooga https://github.com/oobabooga/unsloth.git`; recent commits include `9a2cc341c Phase 16 review fixes: engine-switch unload, sd.cpp error mapping, per-image seeds, Qwen sampler`, `86b3a5d2d [pre-commit.ci] auto fixes from pre-commit.com hooks`, `7f3c206fa Studio diffusion (Phase 16): route no-GPU loads to the native sd.cpp engine`, `9c5b35c71 [pre-commit.ci] auto fix`.
|
||||
- Command run: `git diff --stat` plus marker grep over ambiguous files exited successfully.
|
||||
- Key output: tracked diff includes `scripts/diffusion_bench.py`, `studio/backend/core/inference/diffusion.py`, `studio/backend/core/inference/diffusion_engine_router.py`, `studio/backend/core/inference/diffusion_families.py`, `studio/backend/core/inference/diffusion_memory.py`, `studio/backend/core/inference/diffusion_speed.py`, `studio/backend/core/inference/sd_cpp_backend.py`, and more.
|
||||
- Finding: `studio/backend/core/inference/diffusion_speed.py`, `studio/backend/tests/test_diffusion_speed.py`, `studio/backend/tests/conftest.py`, and `scripts/diffusion_bench.py` are uncommitted changes likely not from this session; grep found 0 of the session’s feature markers in them, about 150 lines total.
|
||||
- Completed: autonomous feature build-out is described as complete: 5 workflows, 6 models, verified/reviewed/deployed.
|
||||
- Completed: deployment is live at `https://influences-qualification-thesis-loop.trycloudflare.com`.
|
||||
- Completed: items reported done include five workflows, six models, Advanced Options, FP8/INT8, two bug fixes, sd.cpp hardening, e2e suite + GIFs, completed review, `FLUX Kontext`, and PR plan.
|
||||
- Pending: commit/push the 3 stacked PRs; assistant asked for explicit authorization before doing this.
|
||||
- Pending: `#152` work requiring hardware/external action: publish `unslothai/stable-diffusion.cpp` mirror plus macOS/Windows staging.
|
||||
- No unresolved errors in this span; only issue found was mixed uncommitted work, documented in the PR plan and left untouched.
|
||||
|
|
@ -1,4 +0,0 @@
|
|||
- Decided lock fp8 `use_fast_accum=True`: protects consumer Blackwell 838 TFLOPS path; 2:4 rejected due LPIPS `0.858`, kernel stride error, compile failure.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/core/inference/diffusion_transformer_quant.py`; created `scripts/sparse_accum_probe.py`.
|
||||
- Ran tests: `14 passed`; final `172 passed, 4993 deselected, 1 warning`.
|
||||
- Push initially rejected; rebased onto `origin/diffusion-phase8-quant`; pushed `ead09c45c`.
|
||||
|
|
@ -1 +0,0 @@
|
|||
Continue the latest actionable directive: ensure the dynamic consumer-vs-non-consumer GPU check exists so the fast path is enabled only on consumer GPUs, using NVIDIA CUDA GPU data as reference. The assistant state says the work was synced and pushed, with all probes including `nvfp4_probe.py` on remote and PR #6694 open/mergeable; do not rerun the completed rebase/push/fetch. Next action is to inspect the current landed gating/probe state only if needed, then give the user the final concise status and answer that NVFP4 is available through torchao but only slow-path here until the fast kernel/torch >= 2.11 path is available.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR `#6694` open/mergeable; commit `983f2c14a`; fp8>mxfp8; `172 passed`.
|
||||
|
|
@ -1,3 +0,0 @@
|
|||
- Decision: removed global weight buffers because benchmarks/allocator profile showed neutral/no useful memory win.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/tests/test_diffusion_speed.py`: removed `install_weight_buffer` stub and weight_buffer assertions; `eager` now expects no GGUF accelerator.
|
||||
- Pending: search/remove remaining refs, delete `scripts/buffer_bench.py`, run `CUDA_VISIBLE_DEVICES="" python -m pytest tests/ -q -k "diffusion"`.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Planner started; user interrupted.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR 6658: supported models?
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Asked if pre-quant also works for `int8`
|
||||
|
|
@ -1 +0,0 @@
|
|||
- Bench: `1.83 s → 0.71 s` 2.56x.
|
||||
|
|
@ -1 +0,0 @@
|
|||
- PR `#6717` int8 prequant fix pending CI
|
||||
|
|
@ -1,16 +0,0 @@
|
|||
- Decision: use ComfyUI fp8 + `--fast` as the fair “ComfyUI best” baseline because earlier GGUF-only comparisons understated ComfyUI’s optimized path.
|
||||
- Decision: compare Z-Image and FLUX.2-klein using bf16 single-file checkpoints loaded through `UNETLoader` with `weight_dtype=fp8_e4m3fn_fast`, because ComfyUI casts to fp8 and this matches its best available dense path.
|
||||
- Decision: final product conclusion is GPU `diffusers+opts` plus CPU/Mac `sd.cpp`, because `diffusers+opts` wins GPU across all 4 models while `sd.cpp` wins CPU.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/comfy_bench.py`: added `z-image-fp8` and `flux.2-klein-fp8` workflow support using ComfyUI fp8 casting.
|
||||
- Edited `/mnt/disks/unslothai/ubuntu/workspace_81/unsloth/outputs/FINAL_engine_comparison.md`: updated final comparison with all 4 ComfyUI best fp8 results and final goal scorecard.
|
||||
- Ran `python3 -c "...HfApi(...).list_repo_files(...)"` to find single-file checkpoints. Key output: `Comfy-Org/z_image_turbo` had `split_files/diffusion_models/z_image_turbo_bf16.safetensors`; `Comfy-Org/flux2-klein` had `split_files/diffusion_models/flux-2-klein-4b.safetensors`; `Comfy-Org/FLUX.2-klein` returned `RepositoryNotFoundError: 404 Client Error`.
|
||||
- Ran download command from `/mnt/disks/unslothai/ubuntu/workspace_81` using `hf_hub_download`; key output: `OK z_image_turbo_bf16.safetensors: 12.31 GB` and `OK flux-2-klein-4b.safetensors: 7.75 GB`.
|
||||
- Ran `python -m py_compile scripts/comfy_bench.py && echo "compile OK"`; exit OK with `compile OK`.
|
||||
- Launched ComfyUI with `CUDA_VISIBLE_DEVICES=7 ComfyUI/.venv/bin/python ComfyUI/main.py --listen 127.0.0.1 --port 8235 --fast`; background server started, later stopped.
|
||||
- Ran benchmark command: `python3 -u scripts/comfy_bench.py --port 8235 --gpu 7 --families z-image-fp8,flux.2-klein-fp8 --tag best2_fp8`; key output: `z-image-fp8` OK `lat=1.51s vram=75.0GB`; `flux.2-klein-fp8` OK `lat=1.00s vram=85.8GB`.
|
||||
- Ran server cleanup command using `ps -ef | grep '[C]omfyUI/main.py' | awk '{print $2}' | while read p; do kill "$p"; done`; key output: `comfy procs: 0`.
|
||||
- Final complete best-vs-best table: `z-image` our `0.509(int8)` vs ComfyUI fp8 `1.51` = `3.0x`; `flux.2-klein` our `0.269(int8)` vs `1.00` = `3.7x`; `flux.1` our `0.518(fp8)` vs `1.00` = `1.9x`; `qwen-image` our `1.78(int8)` vs `6.01` = `3.4x`.
|
||||
- Resolved error: initial repo guess `Comfy-Org/FLUX.2-klein` was missing with `RepositoryNotFoundError: 404 Client Error`; resolved by using `Comfy-Org/flux2-klein`.
|
||||
- Completed: all 4 models now have fair ComfyUI best fp8 comparisons against our best results.
|
||||
- Completed: final conclusion documented that `diffusers+opts` beats ComfyUI GPU best by `1.9–3.7x`, `sd.cpp` beats CPU ComfyUI/diffusers by about `~1.7x`, and accuracy rule is satisfied with `LPIPS ≤ 0.17`.
|
||||
- Pending: none stated in this span.
|
||||
Some files were not shown because too many files have changed in this diff Show more
Loading…
Add table
Add a link
Reference in a new issue