17070c0886
Exclude host-pinned buffers (CUDA_Host etc.) from the GPU buffer-size signal so a binary that pins host memory but loads weights on CPU is not misread as GPU offload. Scan every 'offloaded N/M layers to GPU' line and accept if any N>0 so a speculative draft model logging 0/k before the main model's 33/33 is not flagged CPU-only. Same fix in the installer and runtime classifiers. |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| storage | ||
| tests | ||
| utils | ||
| __init__.py | ||
| _platform_compat.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||
| startup_banner.py | ||