#sglang

vLLM vs SGLang: PagedAttention vs RadixAttention Benchmarks

We benchmarked vLLM vs SGLang on multi-turn agent workloads. RadixAttention prefix caching cut TTFT by 82% over PagedAttention. Here are the benchmarks.