Trace Characterization based Cache Replacement Policy

被引:1
|
作者
Anik, Shafayat Mowla [1 ]
Lee, Byeong Kil [1 ]
机构
[1] Univ Colorado, Dept Elect & Comp Engn, Colorado Springs, CO 80918 USA
来源
2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC | 2022年
关键词
cache replacement; reuse distance; last level cache; cache performance;
D O I
10.1109/IPCCC55026.2022.9894321
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As various types of applications are released; it is required to have more adequate cache replacement policy in the cache of microprocessors. Based on our investigation, cache line eviction is not determined by only a single factor, so multiple factors should be evaluated to find optimal answers. The Least Recently Used (LRU) can only exploit data that has a short reuse distance. However, we observe some of the applications have long reuse distances and some others have a mix of short, mid, and long reuse distances. If the replacement policy can learn the access pattern, we could get better cache performance with extra storage for training and driving the cache. In this paper, we proposed a policy that will train periodically to understand the reuse pattern of the trace and determine the capped reuse distance that will be used for ceiling partial ways of the LLC (Last Level Cache). We see that LRU covers 100% of the short reuse distance but only 3% mid-range and 0% long-range reuse distances. Whereas Ship++ covers 87% short, 67% mid, 46% long distances and Hawkeye covers 94% short, 60% mid, 35% short, similarly our proposed Trace characterization based capped reuse history (TCRH) covers 98% short, 55% mid, 31% long distances. The main goal of the proposed scheme is that the replacement policy should work adequately in different patterns of trace that can be a short-reuse distance, long reuse distance, or mixed reuse distance. We capture some key parameters of the trace by training. Overall TCRH improves MPKI over LRU by similar to 12% which is 12% more than Hawkeye and 30% more than Ship++.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] An optimal cache replacement policy for wireless data dissemination under cache consistency
    Xu, JL
    Hu, QL
    Lee, WC
    Lee, DL
    PROCEEDINGS OF THE 2001 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2001, : 267 - 274
  • [42] Flow-Length Aware Cache Replacement Policy for Packet Processing Cache
    Yamaki, Hayato
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (05) : 12 - 20
  • [43] Improving trace cache processor performance by trace cache hierarchy and path-based trace prefetch
    Wang, KF
    Ji, ZZ
    Hu, MZ
    CHINESE JOURNAL OF ELECTRONICS, 2006, 15 (02): : 231 - 236
  • [44] A simple proof of optimality for the MIN cache replacement policy
    Lee, Mun-Kyu
    Michaud, Pierre
    Sim, Jeong Seop
    Nyang, DaeHun
    INFORMATION PROCESSING LETTERS, 2016, 116 (02) : 168 - 170
  • [45] An effective LRU with random replacement policy for cache memory
    Khanfar, K
    PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 1837 - 1843
  • [46] FRIES-CAR: An adaptive cache replacement policy
    Pallis, G
    Vakali, A
    Sidiropoulos, E
    International Workshop on Challenges in Web Information Retrieval and Integration, Proceedings, 2005, : 74 - 79
  • [47] WRP: Weighting Replacement Policy to Improve Cache Performance
    Samiee, Kaveh
    Rad, GholamAli Rezai
    CSA 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND ITS APPLICATIONS, PROCEEDINGS, 2008, : 38 - 41
  • [48] An energy-efficient replacement policy for data cache
    Musalappa, S
    Sundaram, S
    Chu, Y
    PROCEEDINGS OF THE IEEE SOUTHEASTCON 2004: EXCELLENCE IN ENGINEERING, SCIENCE, AND TECHNOLOGY, 2005, : 599 - 602
  • [49] Predicting Performance Degradation on Adaptive Cache Replacement Policy
    Zhang, Yi
    Cui, Ran
    Lv, Mingsong
    Li, Chuanwen
    Deng, Qingxu
    2020 IEEE 26TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2020, : 109 - 116
  • [50] Behavior analysis of software controlled Cache replacement policy
    Du, Hongyan
    Pan, Yi
    Tian, Xingyan
    Ou, Xinliang
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2009, 37 (08): : 19 - 22