LMCache's Production-Grade Multi-Process KV Cache: Architecture, Observability & Fault Tolerance

Talk overview

This workshop takes a deep look at LMCache's multi-process architecture and the systems engineering required to make KV-cache management observable, fault tolerant, and production ready at scale.