Device Data Ingestion for Industrial Big Data Platforms with a Case Study

被引：32
|
作者：
Ji, Cun [1 ]
Shao, Qingshi [1 ]
Sun, Jiao [1 ]
Liu, Shijun [1 ,2 ]
Pan, Li [1 ,2 ]
Wu, Lei [1 ,3 ]
Yang, Chenglei [1 ,2 ]
机构：
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Shandong Univ, Engn Res Ctr Digital Media Technol, Jinan 250101, Peoples R China
[3] North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100144, Peoples R China
来源：
SENSORS | 2016年 / 16卷 / 03期
基金：
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词：
device data ingestion; big data; internet of things; industrial internet of things; INTERNET;
D O I：
10.3390/s16030279
中图分类号：
O65 [分析化学];
学科分类号：
070302 ; 081704 ;
摘要：
Despite having played a significant role in the Industry 4.0 era, the Internet of Things is currently faced with the challenge of how to ingest large-scale heterogeneous and multi-type device data. In response to this problem we present a heterogeneous device data ingestion model for an industrial big data platform. The model includes device templates and four strategies for data synchronization, data slicing, data splitting and data indexing, respectively. We can ingest device data from multiple sources with this heterogeneous device data ingestion model, which has been verified on our industrial big data platform. In addition, we present a case study on device data-based scenario analysis of industrial big data.
引用
收藏
页数：15
相关论文
共 50 条
  • [21] Data Protection of Internet Enterprise Platforms in the Era of Big Data
    Zhang, Jiaxing
    Yang, Anuo
    Feng Shuaishuai
    JOURNAL OF WEB ENGINEERING, 2022, 21 (03): : 861 - 877
  • [22] Implementation of Data Preprocessing Techniques on Distributed Big Data Platforms
    Celik, Oguz
    Hasanbasoglu, Muruvvet
    Aktas, Mehmet S.
    Kalipsiz, Oya
    Kanli, Alper Nebi
    2019 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2019, : 73 - 78
  • [23] Big Data and Industrial Ecology
    Xu, Ming
    Cai, Hua
    Liang, Sai
    JOURNAL OF INDUSTRIAL ECOLOGY, 2015, 19 (02) : 205 - 210
  • [24] Data Consistency Theory and Case Study for Scientific Big Data
    Shi, Peng
    Cui, Yulin
    Xu, Kangming
    Zhang, Mingmei
    Ding, Lianhong
    INFORMATION, 2019, 10 (04):
  • [25] Big Data Integration Case Study for Radiology Data Sources
    Deshpande, Priya
    Rasin, Alexander
    Brown, Eli
    Furst, Jacob
    Raicu, Daniela S.
    Montner, Steven M.
    Armato, Samuel G., III
    2018 IEEE LIFE SCIENCES CONFERENCE (LSC), 2018, : 195 - 198
  • [26] Big Data Platforms and Tools for Data Analytics in the Data Science Engineering Curriculum
    Demchenko, Yuri
    PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON CLOUD AND BIG DATA COMPUTING (ICCBDC 2019), 2019, : 60 - 64
  • [27] Developing the Raster Big Data Benchmark: A Comparison of Raster Analysis on Big Data Platforms
    Haynes, David
    Mitchell, Philip
    Shook, Eric
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (11)
  • [28] Big data analytics methodologies applied at energy management in industrial sector: A case study
    Bevilacqua M.
    Ciarapica F.E.
    Diamantini C.
    Potena D.
    International Journal of RF Technologies: Research and Applications, 2017, 8 (03) : 105 - 122
  • [29] Exploring spatial path dependence in industrial space with big data: A case study of Beijing
    Yang, Zhenshan
    Wu, Di
    Wang, Dawei
    CITIES, 2021, 108
  • [30] Big Data Ingestion and Lifelong Learning Architecture
    Pal, Gautam
    Li, Gangmin
    Atkinson, Katie
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 5420 - 5423
12345