Skip to content

vllm.models.qwen4_exp.nvidia

Modules:

  • hyperconnection

    HyperConnection (Gated Residual) utilities — NVIDIA model variant.

  • indexer_qsa

    Qwen4Exp weight-free QSA indexer.

  • low_latency_gemm

    Qwen4Exp decode GEMM selection on Hopper and Blackwell.

  • model

    Inference-only Qwen4Exp model.

  • model_state

    Model-runner state for Qwen4Exp PLE inputs.

  • mtp

    Inference-only Qwen4Exp MTP (Multi-Token Predictor) model.

  • ngram_embedding

    Qwen4Exp n-gram embeddings with device and pinned-host storage.

  • ops

    NVIDIA-only Qwen4Exp kernels; import leaf modules directly.

  • ple_layer

    GPU-resident Qwen4Exp position-learning enhancement layers.

  • qsa

    NVIDIA QSA owner with Triton kernels.