vllm.models.qwen4_exp.nvidia ¶
Modules:
-
hyperconnection–HyperConnection (Gated Residual) utilities — NVIDIA model variant.
-
indexer_qsa–Qwen4Exp weight-free QSA indexer.
-
low_latency_gemm–Qwen4Exp decode GEMM selection on Hopper and Blackwell.
-
model–Inference-only Qwen4Exp model.
-
model_state–Model-runner state for Qwen4Exp PLE inputs.
-
mtp–Inference-only Qwen4Exp MTP (Multi-Token Predictor) model.
-
ngram_embedding–Qwen4Exp n-gram embeddings with device and pinned-host storage.
-
ops–NVIDIA-only Qwen4Exp kernels; import leaf modules directly.
-
ple_layer–GPU-resident Qwen4Exp position-learning enhancement layers.
-
qsa–NVIDIA QSA owner with Triton kernels.