Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage

被引:7
|
作者
Mai, Hai Thanh [1 ]
Park, Kyoung Hyun [1 ]
Lee, Hun Soon [1 ]
Kim, Chang Soo [1 ]
Lee, Miyoung [1 ]
Hur, Sung Jin [1 ]
机构
[1] ETRI, SW Content Res Lab, Taejon, South Korea
关键词
Big data storage; hybrid main memory; inmemory data management;
D O I
10.4218/etrij.14.0114.0012
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For memory-based big data storage, using hybrid memories consisting of both dynamic random-access memory (DRAM) and non-volatile random-access memories (NVRAMs) is a promising approach. DRAM supports low access time but consumes much energy, whereas NVRAMs have high access time but do not need energy to retain data. In this paper, we propose a new data migration method that can dynamically move data pages into the most appropriate memories to exploit their strengths and alleviate their weaknesses. We predict the access frequency values of the data pages and then measure comprehensively the gains and costs of each placement choice based on these predicted values. Next, we compute the potential benefits of all choices for each candidate page to make page migration decisions. Extensive experiments show that our method improves over the existing ones the access response time by as much as a factor of four, with similar rates of energy consumption.
引用
收藏
页码:988 / 998
页数:11
相关论文
共 50 条
  • [31] Timo: In-Memory Temporal Query Processing for Big Temporal Data
    Zheng, Xiao
    Liu, Hou-kai
    Wei, Lin-na
    Wu, Xuan-gou
    Zhang, Zhen
    [J]. 2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, : 121 - 126
  • [32] MemepiC: Towards a Unified In-Memory Big Data Management System
    Cai, Qingchao
    Zhang, Hao
    Guo, Wentian
    Chen, Gang
    Ooi, Beng Chin
    Tan, Kian-Lee
    Wong, Weng-Fai
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2019, 5 (01) : 4 - 17
  • [33] Survey of In-memory Big Data Analytics and Latest Research Opportunities
    Gangarde, Rupali
    Pawar, Ambika
    Dani, Ajay
    [J]. 2016 FOURTH INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2016, : 197 - 201
  • [34] Management and Analytic of Biomedical Big Data with Cloud-based In-Memory Database and Dynamic Querying
    Feng, Mengling
    Ghassemi, Mohammad
    Brennan, Thomas
    Ellenberger, John
    Hussain, Ishrar
    Mark, Roger
    [J]. PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 1970 - 1970
  • [35] Timo: In-memory temporal query processing for big temporal data
    Zheng, Xiao
    Liu, Houkai
    Wang, Xiujun
    Wu, Xuangou
    Yu, Feng
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (13):
  • [36] Memory-Disaggregated In-Memory Object Store Framework for Big Data Applications
    Abrahamse, Robin
    Hadnagy, Akos
    Al-Ars, Zaid
    [J]. 2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2022), 2022, : 1228 - 1234
  • [37] Memory-Disaggregated In-Memory Object Store Framework for Big Data Applications
    Abrahamse, Robin
    Hadnagy, Akos
    Al-Ars, Zaid
    [J]. Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2022, 2022, : 1228 - 1234
  • [38] Bridging High Velocity and High Volume Industrial Big Data Through Distributed In-Memory Storage & Analytics
    Williams, Jenny Weisenberg
    Aggour, Kareem S.
    Interrante, John
    McHugh, Justin
    Pool, Eric
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014, : 932 - 941
  • [39] A Dynamic Migration Method for Big Data in Cloud
    Ding Jiaman
    Du Yi
    Wang Sichen
    Jia Lianyin
    [J]. 2016 17TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES (PDCAT), 2016, : 95 - 98
  • [40] Optimized fast data migration for hybrid DRAM/STT-MRAM main memory
    Liu, Chenji
    Chen, Lan
    Hao, Xiaoran
    Ni, Mao
    [J]. IEICE ELECTRONICS EXPRESS, 2022, 19 (01):