High-Quality Token Service: From Heterogeneous PD to Cross-Region AI Infrastructure

Talk overview

This workshop explains how Prefill–Decode disaggregation and Mooncake KV-cache handoff allow heterogeneous resource pools to collaborate across locations. It shares thousand-accelerator commercial deployment experience and cross-building experiments that inform bandwidth and tail-latency planning for cross-region AI infrastructure.