vllm.distributed.ec_transfer.ec_connector ¶

Modules:

• base –

  ECConnectorBase Class for Distributed Encoder Cache &

• cpu –
• example_connector –
• factory –
• mooncake –

  Internal building blocks for the Mooncake encoder-cache connector.

• mooncake_ec_connector –

  Encoder-cache connector backed by Mooncake TransferEngine.

• utils –

  EC connector helper utilities.