Skip to content

vllm.distributed.ec_transfer.ec_connector.mooncake

Internal building blocks for the Mooncake encoder-cache connector.

The public connector remains in :mod:mooncake_ec_connector. This package separates configuration, control-plane messaging, transfer state, registered memory, and worker/scheduler orchestration so that each component has one owner and can be tested independently.

Modules:

  • config –
  • control –

    ZMQ control plane for Mooncake encoder-cache reservations and events.

  • memory –

    Registered-memory allocation and residency for Mooncake transfers.

  • metadata –

    Metadata exchanged by the Mooncake encoder-cache connector.

  • producer –

    Producer-side push lifecycle, futures, and source-tensor ownership.

  • reservation –

    Consumer-side reservation lifecycle and destination-memory ownership.

  • scheduler –

    Scheduler-side planning and observation for Mooncake cache transfers.

  • state –

    Scheduler-owned lifecycle and indexes for Consumer-bound transfers.

  • transfer –

    Mooncake data-plane engine and memory-registration ownership.

  • worker –

    Worker-side orchestration of Mooncake control, memory, and data planes.