Yihua Cheng

发表论文 33 篇 · 总被引 1339 次 · h-index 13

代表论文

• CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving (2023 · Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication · 被引 308)
• CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion (2024 · ACM Transactions on Computer Systems · 被引 251)
• LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference (2025 · arXiv.org · 被引 134)
• GRACE: Loss-Resilient Real-Time Video through Neural Codecs (2023 · Symposium on Networked Systems Design and Implementation · 被引 49)
• CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion (2025 · European Conference on Computer Systems · 被引 41)
• PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications (2025 · Symposium on Operating Systems Principles · 被引 39)