Device Data Ingestion for Industrial Big Data Platforms with a Case Study

被引：32

作者：

Ji, Cun ^{[1
]}

Shao, Qingshi ^{[1
]}

Sun, Jiao ^{[1
]}

Liu, Shijun ^{[1
,2
]}

Pan, Li ^{[1
,2
]}

Wu, Lei ^{[1
,3
]}

Yang, Chenglei ^{[1
,2
]}

机构：

[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China

[2] Shandong Univ, Engn Res Ctr Digital Media Technol, Jinan 250101, Peoples R China

[3] North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100144, Peoples R China

来源：

SENSORS | 2016年 / 16卷 / 03期

基金：

中国国家自然科学基金; 国家高技术研究发展计划(863计划);

关键词：

device data ingestion; big data; internet of things; industrial internet of things; INTERNET;

D O I：

10.3390/s16030279

中图分类号：

O65 [分析化学];

学科分类号：

070302 ; 081704 ;

摘要：

Despite having played a significant role in the Industry 4.0 era, the Internet of Things is currently faced with the challenge of how to ingest large-scale heterogeneous and multi-type device data. In response to this problem we present a heterogeneous device data ingestion model for an industrial big data platform. The model includes device templates and four strategies for data synchronization, data slicing, data splitting and data indexing, respectively. We can ingest device data from multiple sources with this heterogeneous device data ingestion model, which has been verified on our industrial big data platform. In addition, we present a case study on device data-based scenario analysis of industrial big data.

引用

页数：15

共 50 条

[1] IBDP: An Industrial Big Data Ingestion and Analysis Platform and Case Studies
Ji, Cun
Liu, Shijun
Yang, Chenglei
Wu, Lei
Pan, Li
2015 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION, AND KNOWLEDGE IN THE INTERNET OF THINGS (IIKI), 2015, : 223 - 228
[2] Implementation of Hyperparameter Algorithms on Big Data Platforms: A Case Study
Mangliyeva, Mehriniso
Aktas, Mehmet Siddik
Tanriverdi, Berfin
Kalipsiz, Oya
Balcik, Erman
2019 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2019, : 7 - 11
[3] A Performance Study of Big Data Analytics Platforms
Pirzadeh, Pouria
Carey, Michael
Westmann, Till
2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2911 - 2920
[4] Data Mining Library for Big Data Processing Platforms: A Case Study-Sparkling Water Platform
Yildiz, Elif Cansu
Aktas, Mehmet S.
Kalipsiz, Oya
Kanli, Alper Nebi
Turgut, Uncut Orcun
2018 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2018, : 167 - 172
[5] Data Ingestion and Storage Performance of IoT Platforms: Study of OpenIoT
Medvedev, Alexey
Hassani, Alireza
Zaslavsky, Arkady
Jayaraman, Prem Prakash
Indrawan-Santiago, Maria
Haghighi, Pari Delir
Ling, Sea
INTEROPERABILITY AND OPEN-SOURCE SOLUTIONS FOR THE INTERNET OF THINGS (INTEROSS-IOT 2016), 2017, 10218 : 141 - 157
[6] The Impact of Distributed Data in Big Data Platforms on Organizations
Koren, Oded
Binyaminov, Matan
Perel, Nir
PROCEEDINGS OF THE FUTURE TECHNOLOGIES CONFERENCE (FTC) 2018, VOL 2, 2019, 881 : 1024 - 1036
[7] Special Section on Engineering Industrial Big Data Analytics Platforms for Internet of Things
Perera, C.
Vasilakos, A. V.
Calikli, G.
Sheng, Q. Z.
Li, K. -C.
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (02) : 744 - 747
[8] Reusable Big Data System for Industrial Data Mining - A Case Study on Anomaly Detection in Chemical Plants
Borrison, Reuben
Kloepper, Benjamin
Chioua, Moncef
Dix, Marcel
Sprick, Barbara
INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2018, PT I, 2018, 11314 : 611 - 622
[9] Big Data Management: A Case Study on Medical Data
Sulea, Vlad
Ciuciu, Ioana
ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS, OTM 2019, 2020, 11878 : 194 - 198
[10] Big Data Open Source Platforms
Coimbra de Almeida, Pedro Daniel
Bernardino, Jorge
2015 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2015, 2015, : 268 - 275

← 1 2 3 4 5 →