Ignores none params when building the subprocess_command for vllm. As none values stop vllm from deploying properly, as --quantize will be passed with none if quantization type isn't specified in the model name. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| synthetic.py | ||
| synthetic_configs.py | ||