Hello ROCm day1

执行vllm serve ./models/google/gemma-4-E4B-it/ --served-model-name gemma-4-E4B-it遇到问题
Traceback (most recent call last):
File “/opt/venv/lib/python3.12/site-packages/torch/_ops.py”, line 1442, in load_library
ctypes.CDLL(path)
File “/usr/lib/python3.12/ctypes/init.py”, line 379, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /opt/venv/lib/python3.12/site-packages/torchaudio/lib/libtorchaudio.so: undefined symbol: _ZN3c1013MessageLoggerC1EPKcii

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File “/opt/venv/bin/vllm”, line 10, in
sys.exit(main())
^^^^^^
File “/opt/venv/lib/python3.12/site-packages/vllm/entrypoints/cli/main.py”, line 18, in main
import vllm.entrypoints.cli.benchmark.main
File “/opt/venv/lib/python3.12/site-packages/vllm/entrypoints/cli/benchmark/main.py”, line 10, in
from