vllm.v1.metrics ¶

Modules:

• buckets –

  Default bucket boundaries for the Prometheus histograms emitted by vLLM.

• loggers –
• perf –

  Analytic flops/memory estimation module for transformer components,

• prometheus –
• ray_wrappers –
• reader –
• stats –
• utils –