Design and Implementation of Sensory Data Collection and Storage Based on Hadoop Platform

被引:0
|
作者
Bai, Zhen [1 ]
Cui, Shaohua [2 ]
Zhao, Chenglin [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Key Lab Universal Wireless Commun, MOE, Xitucheng Rd 10, Beijing, Peoples R China
[2] China Petr Technol & Dev Corp, Beijing, Peoples R China
关键词
Hadoop platform; Sensory data; Data collection; Data storage;
D O I
10.1007/978-981-13-6508-9_106
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
At present, modern manufacturing and management concepts such as digitization, networking, and intelligence are widely used in the industry. Industry automation and information have been unprecedentedly improved, and therefore the entire life of industrial production link involves massive amounts of data, and the status monitoring data of industrial machine have large, multiple source, heterogeneous, and complex data characteristics. What is more, the traditional processing methods and tools could not meet the requirements for massive data, and may miss the best time to repair machine. So, to resolve the challenges that the industrial sensory big data faces, this paper proposes the sensory data collection and storage based on Hadoop platform.
引用
收藏
页码:870 / 874
页数:5
相关论文
共 50 条
  • [21] Design and Implementation of Data Collection System based on CPS Model
    Guo, An
    Yu, Dong
    Hu, Yi
    Wang, Shuai
    An, Tao
    Zhang, Tengfei
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND MECHANICAL AUTOMATION (CSMA), 2015, : 139 - 143
  • [22] Design and Implementation of an Ambient Data Collection Mechanism Based on a Quadcopter
    Chang, Jui-Hung
    Chen, Yu-Yun
    Huang, Yueh-Min
    [J]. 2018 FIRST INTERNATIONAL COGNITIVE CITIES CONFERENCE (IC3 2018), 2018, : 32 - 36
  • [23] Metadata Storage and Query of Hive Based on Hadoop Distributed Platform
    Xu, Hongsheng
    Wang, Lan
    Fan, Ganglong
    [J]. CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 : 1079 - 1085
  • [24] METECLOUD: A PRIVATE CLOUD PLATFORM FOR METEOROLOGICAL DATA STORAGE USING HADOOP
    Xue Shengjun
    Xu Xiaolong
    Wang Delong
    Zhang Jie
    Ji Feng
    [J]. INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2013, 6 (02): : 648 - 663
  • [25] The Design and Implementation of Geographic Information Storage System Based on the Cloud Platform
    Wang, Zhibo
    Hu, Kuai
    Li, Ying
    Li, Gaole
    Sun, Tianrun
    Zhu, Weiping
    Cui, Xiaohui
    [J]. GEO-INFORMATICS IN RESOURCE MANAGEMENT AND SUSTAINABLE ECOSYSTEM, 2016, 569 : 917 - 928
  • [26] Design and Implementation of Data Mining Platform Based on the Cloud Computing
    Zhu Jia
    Zhang Ping
    [J]. PROCEEDINGS OF 2014 IEEE WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS (WARTIA), 2014, : 163 - 165
  • [27] Design and Implementation of a Data Mining Platform Based on Cloud Computing
    Nie, Jing
    [J]. AGRO FOOD INDUSTRY HI-TECH, 2017, 28 (01): : 318 - 321
  • [28] Design and Implementation of Smart Teaching Platform Based on Big Data
    Lei Lin
    [J]. PROCEEDINGS OF THE THIRD INTERNATIONAL SYMPOSIUM - EDUCATIONAL RESEARCH AND EDUCATIONAL TECHNOLOGY, 2019, 2019, : 57 - 62
  • [29] Seismic Data Attribute Extraction Based on Hadoop Platform
    Ma Zhonghua
    [J]. 2017 2ND IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA 2017), 2017, : 180 - 184
  • [30] Huge Data Analysis and Processing Platform based on Hadoop
    Li, Yuanbin
    Chen, Rong
    [J]. PROCEEDINGS OF THE 2017 2ND INTERNATIONAL CONFERENCE ON MATERIALS SCIENCE, MACHINERY AND ENERGY ENGINEERING (MSMEE 2017), 2017, 123 : 267 - 271