Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage

被引:7
|
作者
Mai, Hai Thanh [1 ]
Park, Kyoung Hyun [1 ]
Lee, Hun Soon [1 ]
Kim, Chang Soo [1 ]
Lee, Miyoung [1 ]
Hur, Sung Jin [1 ]
机构
[1] ETRI, SW Content Res Lab, Taejon, South Korea
关键词
Big data storage; hybrid main memory; inmemory data management;
D O I
10.4218/etrij.14.0114.0012
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For memory-based big data storage, using hybrid memories consisting of both dynamic random-access memory (DRAM) and non-volatile random-access memories (NVRAMs) is a promising approach. DRAM supports low access time but consumes much energy, whereas NVRAMs have high access time but do not need energy to retain data. In this paper, we propose a new data migration method that can dynamically move data pages into the most appropriate memories to exploit their strengths and alleviate their weaknesses. We predict the access frequency values of the data pages and then measure comprehensively the gains and costs of each placement choice based on these predicted values. Next, we compute the potential benefits of all choices for each candidate page to make page migration decisions. Extensive experiments show that our method improves over the existing ones the access response time by as much as a factor of four, with similar rates of energy consumption.
引用
收藏
页码:988 / 998
页数:11
相关论文
共 50 条
  • [1] In-Memory Performance for Big Data
    Graefe, Goetz
    Volos, Haris
    Kimura, Hideaki
    Kuno, Harumi
    Tucek, Joseph
    Lillibridge, Mark
    Veitch, Alistair
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 8 (01): : 37 - 48
  • [2] A hybrid memory built by SSD and DRAM to support in-memory Big Data analytics
    Chen, Zhiguang
    Lu, Yutong
    Xiao, Nong
    Liu, Fang
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2014, 41 (02) : 335 - 354
  • [3] A hybrid memory built by SSD and DRAM to support in-memory Big Data analytics
    Zhiguang Chen
    Yutong Lu
    Nong Xiao
    Fang Liu
    [J]. Knowledge and Information Systems, 2014, 41 : 335 - 354
  • [4] Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory
    Zhao, Wenze
    Du, Yajuan
    Zhang, Mingzhe
    Liu, Mingyang
    Jin, Kailun
    Ausavarungnirun, Rachata
    [J]. MICROMACHINES, 2022, 13 (01)
  • [5] Data Prefetching and Eviction Mechanisms of In-Memory Storage Systems Based on Scheduling for Big Data Processing
    Chen, Chien-Hung
    Hsia, Ting-Yuan
    Huang, Yennun
    Kuo, Sy-Yen
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (08) : 1738 - 1752
  • [6] LeanStore: In-Memory Data Management Beyond Main Memory
    Leis, Viktor
    Haubenschild, Michael
    Kemper, Alfons
    Neumann, Thomas
    [J]. 2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 185 - 196
  • [7] Migration algorithm for big marine data in hybrid cloud storage
    [J]. Huang, D. (dmhuang@shou.edu.cn), 1600, Science Press (51):
  • [8] In-Memory Big Data Management and Processing: A Survey
    Zhang, Hao
    Chen, Gang
    Ooi, Beng Chin
    Tan, Kian-Lee
    Zhang, Meihui
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (07) : 1920 - 1948
  • [9] Distributed In-Memory Analytics for Big Temporal Data
    Yao, Bin
    Zhang, Wei
    Wang, Zhi-Jie
    Chen, Zhongpu
    Shang, Shuo
    Zheng, Kai
    Guo, Minyi
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2018, PT I, 2018, 10827 : 549 - 565
  • [10] Simba: Spatial In-Memory Big Data Analysis
    Xie, Dong
    Li, Feifei
    Yao, Bin
    Li, Gefei
    Chen, Zhongpu
    Zhou, Liang
    Guo, Minyi
    [J]. 24TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS (ACM SIGSPATIAL GIS 2016), 2016,