Skip to content

feat: add vLLM prefix cache and preemption metrics#2843

Open
puneeshkhanna wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
puneeshkhanna:feat/vllm_prefix_counters
Open

feat: add vLLM prefix cache and preemption metrics#2843
puneeshkhanna wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
puneeshkhanna:feat/vllm_prefix_counters

feat: add vLLM prefix cache and preemption metrics

fb0293b
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 17, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO