[Bug]: GPU索引指定失败

[hackerhaiJu]

Your current environment

export CUDA_VISIBLE_DEVICES=2,3 && vllm serve QwQ-32B
--dtype half
--tensor-parallel-size 2
--cpu-offload-gb 1
--gpu-memory-utilization 0.9
--port 9000

指定了GPU为2和3，但是启动模型依旧选择了0显卡，vllm版本0.7.2

🐛 Describe the bug

export CUDA_VISIBLE_DEVICES=2,3 && vllm serve QwQ-32B
--dtype half
--tensor-parallel-size 2
--cpu-offload-gb 1
--gpu-memory-utilization 0.9
--port 9000

指定了GPU为2和3，但是启动模型依旧选择了0显卡，vllm版本0.7.2

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.