FrozenHot Cache: Rethinking Cache Management for Modern Hardware

作者：Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu · 年份：2023 · DOI：10.1145/3552326.3587446 · 被引用次数：28 · 研究领域：Advanced Data Storage Technologies、Cloud Computing and Resource Management、Parallel Computing and Optimization Techniques

Caching is crucial for accelerating data access, employed as a ubiquitous design in modern systems at many parts of computer systems. With increasing core count, and shrinking latency gap between cache and modern storage devices, hit-path scalability becomes increasingly critical. However, existing production in-memory caches often use list-based management with promotion on each cache hit, which requires extensive locking and poses a significant overhead for scaling beyond a few cores. Moreover, existing techniques for improving scalability either (1) only focus on the indexing structure and do not improve cache management scalability, or (2) sacrifice efficiency or miss-path scalability.