2b7a787075
- Linux: CUDA detection via /usr/local/cuda*, Ninja preferred - macOS: Metal backend auto-enabled (llama.cpp default), no CUDA - Windows: CUDA via CUDA_PATH env and toolkit dirs, VS generator fallback, binaries in build/bin/Release/, copy instead of symlink - Reuse existing source (don't re-clone if CMakeLists.txt present) - Both llama-server and llama-quantize verified and built |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| tests | ||
| utils | ||
| __init__.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||