Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage

被引:7
|
作者
Mai, Hai Thanh [1 ]
Park, Kyoung Hyun [1 ]
Lee, Hun Soon [1 ]
Kim, Chang Soo [1 ]
Lee, Miyoung [1 ]
Hur, Sung Jin [1 ]
机构
[1] ETRI, SW Content Res Lab, Taejon, South Korea
关键词
Big data storage; hybrid main memory; inmemory data management;
D O I
10.4218/etrij.14.0114.0012
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For memory-based big data storage, using hybrid memories consisting of both dynamic random-access memory (DRAM) and non-volatile random-access memories (NVRAMs) is a promising approach. DRAM supports low access time but consumes much energy, whereas NVRAMs have high access time but do not need energy to retain data. In this paper, we propose a new data migration method that can dynamically move data pages into the most appropriate memories to exploit their strengths and alleviate their weaknesses. We predict the access frequency values of the data pages and then measure comprehensively the gains and costs of each placement choice based on these predicted values. Next, we compute the potential benefits of all choices for each candidate page to make page migration decisions. Extensive experiments show that our method improves over the existing ones the access response time by as much as a factor of four, with similar rates of energy consumption.
引用
收藏
页码:988 / 998
页数:11
相关论文
共 50 条
  • [21] A Dependency-Aware Storage Schema Selection Mechanism for In-Memory Big Data Computing Frameworks
    Wang, Bo
    Tang, Jie
    Zhang, Rui
    Ding, Wei
    Qi, Deyu
    [J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2019, 47 (03) : 502 - 519
  • [22] A Big data dynamic migration strategy
    Zhang Jin Fang
    Wang Qing Xin
    Ding Jia Man
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MATERIAL, MECHANICAL AND MANUFACTURING ENGINEERING, 2015, 27 : 1888 - 1891
  • [23] A Dependency-Aware Storage Schema Selection Mechanism for In-Memory Big Data Computing Frameworks
    Bo Wang
    Jie Tang
    Rui Zhang
    Wei Ding
    Deyu Qi
    [J]. International Journal of Parallel Programming, 2019, 47 : 502 - 519
  • [24] Dynamic data auditing scheme for big data storage
    Xingyue Chen
    Tao Shang
    Feng Zhang
    Jianwei Liu
    Zhenyu Guan
    [J]. Frontiers of Computer Science, 2020, 14 : 219 - 229
  • [25] Dynamic data auditing scheme for big data storage
    Chen, Xingyue
    Shang, Tao
    Zhang, Feng
    Liu, Jianwei
    Guan, Zhenyu
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2020, 14 (01) : 219 - 229
  • [26] SharkDB:An In-Memory Storage System for Massive Trajectory Data
    Wang, Haozhou
    Zheng, Kai
    Zhou, Xiaofang
    Sadiq, Shazia
    [J]. SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 1099 - 1104
  • [27] IMSS: In-Memory Storage System for Data Intensive Applications
    Garcia-Blas, Javier
    Singh, David E.
    Carretero, Jesus
    [J]. HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2022 INTERNATIONAL WORKSHOPS, 2022, 13387 : 190 - 205
  • [28] MEMTUNE: Dynamic Memory Management for In-memory Data Analytic Platforms
    Xu, Luna
    Li, Min
    Zhang, Li
    Butt, Ali R.
    Wang, Yandong
    Hu, Zane Zhenhua
    [J]. 2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2016), 2016, : 383 - 392
  • [29] Data Allocation and Migration for Beidou Navigation Terminals with Hybrid PCM Main Memory
    Liu, Tiantian
    Yue, Qiang
    Wu, Xiaoqiang
    [J]. PROCEEDINGS OF 2016 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2016, : 423 - 427
  • [30] In-Memory Computing Architectures for Big Data and Machine Learning Applications
    Snasel, Vaclav
    Tran Khanh Dang
    Pham, Phuong N. H.
    Kueng, Josef
    Kong, Lingping
    [J]. FUTURE DATA AND SECURITY ENGINEERING. BIG DATA, SECURITY AND PRIVACY, SMART CITY AND INDUSTRY 4.0 APPLICATIONS, FDSE 2022, 2022, 1688 : 19 - 33