Facility Information Management on HBase: Large-Scale Storage for Time-Series Data

被引:4
|
作者
Ochiai, Hideya [1 ]
Ikegami, Hiroyuki [2 ]
Teranishi, Yuuichi [3 ]
Esaki, Hiroshi [2 ]
机构
[1] Univ Tokyo, NICT, Tokyo 1138654, Japan
[2] Univ Tokyo, Tokyo 1138654, Japan
[3] Osaka Univ, NICT, Suita, Osaka 565, Japan
关键词
Internet of Things; Time-Series Data; HBase; Hadoop;
D O I
10.1109/COMPSACW.2014.54
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
A very large number of sensors on facilities such as HVAC, light control systems and electric power meters, periodically submit their status information to Cloud platforms these days. As the amount of data can easily get petabyte scale, we must consider the use of distributed application layer storage for managing such facility information, which is often formatted on time-series data. This paper describes FIAPStoragePeta, petabyte scale storage for facility information access protocol (FIAP), proposing the architecture and the scheme of such data management on HBase. In this work, we have identified three requirements to the design of HBase row keys for implementing this storage using HBase. Though, we have not finished petabyte scale experiments, our preliminary evaluation results have shown good performance for managing large scale facility information. It has achieved scalable data retrieval on the data of 10 million sensors with properly balancing loads on distributed data storages.
引用
收藏
页码:306 / 311
页数:6
相关论文
共 50 条
  • [1] Hadoop-HBase for Large-Scale Data
    Vora, Mehul Nalin
    [J]. 2011 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), VOLS 1-4, 2012, : 601 - 605
  • [2] Developing a Visual Analytics Tool for Large-scale Proteomics Time-series Data
    Jenny Vuong
    Stolte, Christian
    Kaur, Sandeep
    O'Donoghue, Sean
    [J]. 2016 INTERNATIONAL SYMPOSIUM ON BIG DATA VISUAL ANALYTICS (BDVA), 2016, : 68 - 69
  • [3] LARGE-SCALE FLUCTUATIONS IN UNDERGROUND MUON TIME-SERIES
    BERGAMASCO, L
    PROVENZALE, A
    OSBORNE, AR
    CASTAGNOLI, GC
    KUDRYAVTSEV, VA
    KUZNETSOV, VA
    RYAZHKAYA, OG
    [J]. JOURNAL OF GEOPHYSICAL RESEARCH-SPACE PHYSICS, 1989, 94 (A3): : 2667 - 2671
  • [4] A new EPICS time-series data archiver using HBase
    Wenwen Shen
    Youxin Chen
    Hai Zheng
    Jing Wang
    Guoqiang Shen
    Guirong Huang
    [J]. Radiation Detection Technology and Methods, 2021, 5 : 550 - 557
  • [5] A LARGE-SCALE NETWORK STORAGE FACILITY
    DAKIN, RJ
    LEDERER, BR
    PARKER, KR
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 1985, 15 (09): : 889 - 899
  • [6] A new EPICS time-series data archiver using HBase
    Shen, Wenwen
    Chen, Youxin
    Zheng, Hai
    Wang, Jing
    Shen, Guoqiang
    Huang, Guirong
    [J]. RADIATION DETECTION TECHNOLOGY AND METHODS, 2021, 5 (4) : 550 - 557
  • [7] A large-scale framework for storage, access and analysis of time series data in the manufacturing domain
    Moerzinger, Benjamin
    Weiler, Thomas
    Trautner, Thomas
    Ayatollahi, Iman
    Angerer, Bernhard
    Kittl, Burkhard
    [J]. 11TH CIRP CONFERENCE ON INTELLIGENT COMPUTATION IN MANUFACTURING ENGINEERING, 2018, 67 : 595 - 600
  • [8] An Efficient NoSQL-Based Storage Schema for Large-Scale Time Series Data
    Ma, Ruizhe
    Zhou, Weiwei
    Ma, Zongmin
    [J]. JOURNAL OF DATABASE MANAGEMENT, 2024, 35 (01)
  • [9] A Methodology for Large-Scale Ocean Wave Power Time-Series Generation
    Brekken, Ted K. A.
    Ozkan-Haller, H. Tuba
    Simmons, Asher
    [J]. IEEE JOURNAL OF OCEANIC ENGINEERING, 2012, 37 (02) : 294 - 300
  • [10] NexusDB: A Large-Scale Distributed Time-Series Database for Industrial Scenarios
    Ding, Linlin
    Chzhen, Di Yuan
    Li, Yuda
    Zhang, Zhiyong
    Xie, Zhiran
    Li, Mo
    [J]. WEB AND BIG DATA, APWEB-WAIM 2024, PT V, 2024, 14965 : 408 - 412