#kvcached

kvcached provides a virtualized, elastic KV cache for LLM serving on shared GPUs, reducing memory waste and speeding activation across colocated models.