Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage

被引:7
|
作者
Mai, Hai Thanh [1 ]
Park, Kyoung Hyun [1 ]
Lee, Hun Soon [1 ]
Kim, Chang Soo [1 ]
Lee, Miyoung [1 ]
Hur, Sung Jin [1 ]
机构
[1] ETRI, SW Content Res Lab, Taejon, South Korea
关键词
Big data storage; hybrid main memory; inmemory data management;
D O I
10.4218/etrij.14.0114.0012
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For memory-based big data storage, using hybrid memories consisting of both dynamic random-access memory (DRAM) and non-volatile random-access memories (NVRAMs) is a promising approach. DRAM supports low access time but consumes much energy, whereas NVRAMs have high access time but do not need energy to retain data. In this paper, we propose a new data migration method that can dynamically move data pages into the most appropriate memories to exploit their strengths and alleviate their weaknesses. We predict the access frequency values of the data pages and then measure comprehensively the gains and costs of each placement choice based on these predicted values. Next, we compute the potential benefits of all choices for each candidate page to make page migration decisions. Extensive experiments show that our method improves over the existing ones the access response time by as much as a factor of four, with similar rates of energy consumption.
引用
收藏
页码:988 / 998
页数:11
相关论文
共 50 条
  • [41] Optimized fast data migration for hybrid DRAM/STT-MRAM main memory
    Liu, Chenji
    Chen, Lan
    Hao, Xiaoran
    Ni, Mao
    [J]. IEICE ELECTRONICS EXPRESS, 2021,
  • [42] An empirical comparison of the performances of single structure columnar in-memory and disk-resident data storage techniques using healthcare big data
    R. F. Famutimi
    M. O. Oyelami
    A. O. Ibitoye
    O. M. Awoniran
    [J]. Journal of Big Data, 10
  • [43] An empirical comparison of the performances of single structure columnar in-memory and disk-resident data storage techniques using healthcare big data
    Famutimi, R. F.
    Oyelami, M. O.
    Ibitoye, A. O.
    Awoniran, O. M.
    [J]. JOURNAL OF BIG DATA, 2023, 10 (01)
  • [44] Design and implementation of reconfigurable acceleration for in-memory distributed big data computing
    Hou, Junjie
    Zhu, Yongxin
    Du, Sen
    Song, Shijin
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 92 : 68 - 75
  • [45] Exploration of In-Memory Computing for Big Data Analytics using Queuing Theory
    Srivastava, Riktesh
    [J]. 2018 2ND INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPILATION, COMPUTING AND COMMUNICATIONS (HP3C 2018), 2018, : 11 - 16
  • [46] Big data availability: Selective partial checkpointing for in-memory database queries
    Playfair, Daniel
    Trehan, Amitabh
    McLarnon, Barry
    Nikolopoulos, Dimitrios S.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, : 2785 - 2794
  • [47] An In-Memory Data-Cube Aware Distributed Data Discovery Across Clouds for Remote Sensing Big Data
    Song, Jie
    Ma, Yan
    Zhang, Zhixin
    Liu, Peng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4529 - 4548
  • [48] A Parallel Randomized Neural Network on In-memory Cluster Computing for Big Data
    Dai, Tongwu
    Li, Kenli
    Chen, Cen
    [J]. 2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017,
  • [49] ClimateSpark: An in-memory distributed computing framework for big climate data analytics
    Hu, Fei
    Yang, Chaowei
    Schnase, John L.
    Duffy, Daniel Q.
    Xu, Mengchao
    Bowen, Michael K.
    Lee, Tsengdar
    Song, Weiwei
    [J]. COMPUTERS & GEOSCIENCES, 2018, 115 : 154 - 166
  • [50] Massively Parallel Big Data Classification on a Programmable Processing In-Memory Architecture
    Kim, Yeseong
    Imani, Mohsen
    Gupta, Saransh
    Zhou, Minxuan
    Rosing, Tajana S.
    [J]. 2021 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN (ICCAD), 2021,