hailin
/
vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
vllm/vllm_v0.10.0/examples/online_serving/disaggregated_serving
History
hailin 38d813617c first commit 2025-08-03 20:28:19 +08:00
..
README.md first commit 2025-08-03 20:28:19 +08:00
disagg_proxy_demo.py first commit 2025-08-03 20:28:19 +08:00
kv_events.sh first commit 2025-08-03 20:28:19 +08:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

  • disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
  • kv_events.sh - Demonstrates KV cache event publishing.