f1293fe7d8
If CUDA_VISIBLE_DEVICES is already set in the environment (e.g., by the user or a wrapper script), only consider those GPUs when selecting devices for llama-server. nvidia-smi reports all physical GPUs regardless of CUDA_VISIBLE_DEVICES, so we filter its output to match the allowed set. Without this, the GPU selector could pick a GPU outside the user's allowed set, overriding their restriction. |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| __init__.py | ||
| install_python_stack.py | ||
| LICENSE.AGPL-3.0 | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||