prefill-decode disaggregation

1 article tagged with this topic

Building the foundation for running extra-large language models

Cloudflare details prefill- decode disaggregation and hardware configs powering Kimi K2.5 on Workers AI, achieving 3x speed gains.