Netpreme Blog

News, research, and updates from the Netpreme team.

Chart: SGLang HiCache end-to-end throughput, X-Mem against Host DRAM, TPS per user versus output token throughput

Accelerating SGLang HiCache with Netpreme X-Mem™ MPU

How Netpreme X-Mem integrates with SGLang HiCache as a dedicated TB/s KV memory tier for faster prefix-cache reuse.