ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fix: name unsloth_vllm_standby parameter in vLLM standby error (#7089)

Browse source 
* fix: name unsloth_vllm_standby parameter in vLLM standby error

FastBaseModel.from_pretrained's vLLM-standby guard raised
"UNSLOTH_VLLM_STANDBY is True, but UNSLOTH_VLLM_STANDBY is not set to 1",
naming the environment variable in both clauses. The value that is True is
the unsloth_vllm_standby parameter, not the env var, so the message was
self-contradictory. Name the parameter in the first clause, matching the
sibling guard in FastLlamaModel.from_pretrained.

Signed-off-by: Anas Khan <83116240+anxkhn@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Remove vLLM standby error message test

---------

Signed-off-by: Anas Khan <83116240+anxkhn@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: danielhanchen <michaelhan2050@gmail.com>
This commit is contained in:
Anas Khan 2026-07-15 12:53:06 +05:30 • committed by GitHub
commit f9aa818ca8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
unsloth/models/vision.py
View file

@ -739,7 +739,7 @@ class FastBaseModel:
if unsloth_vllm_standby and os.environ.get("UNSLOTH_VLLM_STANDBY", "0") != "1":
raise RuntimeError(
"Unsloth: UNSLOTH_VLLM_STANDBY is True, but UNSLOTH_VLLM_STANDBY is not set to 1!"
"Unsloth: `unsloth_vllm_standby` is True, but environment variable `UNSLOTH_VLLM_STANDBY` is not set to 1!"
)
if model_types is None: