Announcement_3
New preprint on arXiv (co-first author): KARA: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression!
New preprint on arXiv (co-first author): KARA: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression!