Skip to content

vllm.distributed.ec_transfer.ec_connector.cpu

Modules:

  • common –

    Shared types for the ECCPUConnector scheduler and worker delegates.

  • connector –

    ECCPUConnector — CPU encoder-cache offloading.

  • control –
  • data –
  • ec_shared_region –

    Lightweight mmap-backed shared memory region for encoder cache (EC) data.

  • protocol –

    Scheduler-side wire types for the ECCPUConnector.

  • scheduler –

    ECCPUScheduler — CPU offload scheduler delegate.

  • session –

    Session objects for the ECCPUConnector.

  • utils –

    Supporting utilities for the ECCPUConnector scheduler.

  • worker –

    Worker-side of the ECCPUConnector.