ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/async_task_outputs/async_task_output_6z1qxq.md
Daniel Han c800e89206 Merge remote-tracking branch 'origin/image-generation' into diffusion-image-workflows 
# Conflicts:
#	studio/backend/core/inference/diffusion.py
#	studio/frontend/src/features/images/images-page.tsx
2026-07-02 03:36:50 +00:00

1.9 KiB
Raw Blame History

  • Decision: removed Studio diffusion weight-buffer feature because allocator already pools per-forward casts with no cudaMalloc churn, so end-to-end impact was neutral; left upstream LLM WEIGHT_BUFFERS in unsloth/kernels/utils.py untouched because unrelated reference path.
  • Edited /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion_gguf_compile.py: removed _WEIGHT_BUFFERS, _weight_buffer, _buffered_forward_native, install_weight_buffer, uninstall_weight_buffer, is_weight_buffer_installed, env flag; docstring now explains removal.
  • Edited /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion_speed.py: removed "weight_buffer" flag and install block; docstrings clarify eager has no GGUF accelerator.
  • Edited /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/studio/backend/diffusion.py: removed buffer comments; uninstall_all() only reverts compiled-dequant.
  • Edited tests: removed 6 weight-buffer tests; updated test_speed_eager_gguf_installs_no_accelerator; _stub_gguf_accel now records compiled-dequant only.
  • Deleted /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/scripts/buffer_bench.py.
  • Ran grep -rn -i "weight_buffer\|buffered_forward\|install_weight_buffer\|WEIGHT_BUFFERS\|_buffered_forward_native\|is_weight_buffer" --include="*.py" studio/; key output: no hits.
  • Ran CUDA_VISIBLE_DEVICES="" python -m pytest tests/test_diffusion_speed.py tests/test_diffusion_gguf_compile.py tests/test_diffusion_arch_patches.py -q; result 28 passed in 7.84s.
  • Ran CUDA_VISIBLE_DEVICES="" python -m pytest tests/ -q -k "diffusion"; result 294 passed, 1 skipped, 5012 deselected, 1 warning in 13.38s.
  • Ran tree-wide grep for removed symbols; only remaining hits are WEIGHT_BUFFERS in /mnt/disks/unslothai/ubuntu/workspace_81/unsloth/unsloth/kernels/utils.py, intentionally not changed.
  • COMPLETED: Studio diffusion global-buffer removal and verification.
  • PENDING: none in this span.