Device Data Ingestion for Industrial Big Data Platforms with a Case Study

被引：32
|
作者：
Ji, Cun [1 ]
Shao, Qingshi [1 ]
Sun, Jiao [1 ]
Liu, Shijun [1 ,2 ]
Pan, Li [1 ,2 ]
Wu, Lei [1 ,3 ]
Yang, Chenglei [1 ,2 ]
机构：
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Shandong Univ, Engn Res Ctr Digital Media Technol, Jinan 250101, Peoples R China
[3] North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100144, Peoples R China
来源：
SENSORS | 2016年 / 16卷 / 03期
基金：
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词：
device data ingestion; big data; internet of things; industrial internet of things; INTERNET;
D O I：
10.3390/s16030279
中图分类号：
O65 [分析化学];
学科分类号：
070302 ; 081704 ;
摘要：
Despite having played a significant role in the Industry 4.0 era, the Internet of Things is currently faced with the challenge of how to ingest large-scale heterogeneous and multi-type device data. In response to this problem we present a heterogeneous device data ingestion model for an industrial big data platform. The model includes device templates and four strategies for data synchronization, data slicing, data splitting and data indexing, respectively. We can ingest device data from multiple sources with this heterogeneous device data ingestion model, which has been verified on our industrial big data platform. In addition, we present a case study on device data-based scenario analysis of industrial big data.
引用
收藏
页数：15
相关论文
共 50 条
  • [31] Optimizing Data Processing: A Comparative Study of Big Data Platforms in Edge, Fog, and Cloud Layers
    Shwe, Thanda
    Aritsugi, Masayoshi
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [32] Data reconciliation - An industrial case study
    Weiss, GH
    Romagnoli, JA
    Islam, KA
    COMPUTERS & CHEMICAL ENGINEERING, 1996, 20 (12) : 1441 - 1449
  • [33] SVIS: Large Scale Video Data Ingestion into Big Data Platform
    Guo, Xiaoyan
    Cao, Yu
    Tao, Jun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2015, 2015, 9052 : 300 - 306
  • [34] Industrial Big Data: From Data to Information to Actions
    Kirmse, Andreas
    Kuschicke, Felix
    Hoffmann, Max
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS, BIG DATA AND SECURITY (IOTBDS 2019), 2019, : 137 - 146
  • [35] A runtime sharing mechanism for Big Data platforms
    Shtern, Mark
    Litoiu, Marin
    2014 10TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2014, : 304 - 307
  • [36] Experimental Survey of Geospatial Big Data Platforms
    More, Nilkamal P.
    Nikam, V. B.
    Sen, Sumit S.
    2018 IEEE 25TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING WORKSHOPS (HIPCW), 2018, : 137 - 143
  • [37] Big Data Monetization: Platforms and Business Models
    Monteiro, Domingos S. M. P.
    Meira, Silvio R. L.
    Ferraz, Felipe Silva
    PROCEEDINGS OF 2021 16TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI'2021), 2021,
  • [38] Towards a Methodology for Evaluating Big Data Platforms
    Kavakli, Evangelia
    Sakellariou, Rizos
    Stankovski, Vlado
    2019 IEEE WORLD CONGRESS ON SERVICES (IEEE SERVICES 2019), 2019, : 380 - 381
  • [39] Optimized Multiple Platforms for Big Data Analysis
    Chang, Bao Rong
    Tsai, Hsiu-Fen
    Wang, Yo-Ai
    2016 IEEE SECOND INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2016, : 155 - 158
  • [40] AutoCompBD: Autonomic Computing and Big Data platforms
    Florin Pop
    Ciprian Dobre
    Alexandru Costan
    Soft Computing, 2017, 21 : 4497 - 4499
12345