Design and Implementation of Smart City Big Data Processing Platform Based On Distributed Architecture

被引：6
|
作者：
Ma, Shuangmei [1 ]
Liang, Zhengli [1 ]
机构：
[1] Commun Univ China, Sch Econ & Management, Beijing, Peoples R China
来源：
2015 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND KNOWLEDGE ENGINEERING (ISKE) | 2015年
关键词：
Smart City; distributed architecture; Big Data processing platform;
D O I：
10.1109/ISKE.2015.7
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
For the problem about the low shared efficiency and the poor integrating degree of the massive multivariate data, in the paper, we propose a design scheme based on distributed architecture, mainly using Kafka, Storm and Spark clusters, and the real-time transmission among the structured data, unstructured data and database data are implemented. And the real-time analysis system of real-time data and statistical analysis system of offline data are developed. Finally, the test results show the performance of Big Data processing platform, and demonstrate fully the advantage of the distributed architecture.
引用
收藏
页码：428 / 433
页数：6
相关论文
共 50 条
  • [1] Design and Implementation of Smart City Big Data Processing Platform Based On Distributed Architecture
    Ma, Shuang-mei
    Liang, Zheng-li
    [J]. 2016 INTERNATIONAL CONFERENCE ON BUSINESS AND MANAGEMENT (ICBM 2016), 2016, : 43 - 48
  • [2] Big Data Processing Platform for smart city
    El Mendili, Saida
    El Bouzekri El Idrissi, Younes
    Hmina, Nabil
    [J]. 2018 INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2018,
  • [3] Design and Implementation of Smart Teaching Platform Based on Big Data
    Lei Lin
    [J]. PROCEEDINGS OF THE THIRD INTERNATIONAL SYMPOSIUM - EDUCATIONAL RESEARCH AND EDUCATIONAL TECHNOLOGY, 2019, 2019, : 57 - 62
  • [4] Architecture Design of Distributed Medical Big Data Platform Based on Spark
    Tu, Yongqiu
    Lu, Yiqiang
    Chen, Guohua
    Zhao, Jie
    Yi, Faling
    [J]. PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 682 - 685
  • [5] Big Data Based Logistics Data Mining Platform: Architecture and Implementation
    Gao, Fei
    Zhao, Qilan
    [J]. INTERNATIONAL JOURNAL OF INTERDISCIPLINARY TELECOMMUNICATIONS AND NETWORKING, 2014, 6 (04) : 24 - 34
  • [6] A Design of Processing Platform for Smartphone Based on Big Data
    Zhang, Jie
    Zhang, Ke
    Zhou, Hengxin
    [J]. 2015 8TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2015, : 162 - 165
  • [7] Smart Medical Big Data Platform Based on Distributed File System
    Cai, Yonghua
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 127 : 111 - 111
  • [8] Distributed Big Data Mining Platform for Smart Grid
    Wang, Zhixiang
    Wu, Bin
    Bai, Demeng
    Qin, Jiafeng
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2345 - 2354
  • [9] City Data Hub: Implementation of Standard-Based Smart City Data Platform for Interoperability
    Jeong, Seungmyeong
    Kim, Seongyun
    Kim, Jaeho
    [J]. SENSORS, 2020, 20 (23) : 1 - 20
  • [10] The Design and Implementation of Smart Grid High Volume Data Management Platform Architecture
    Yang, Zhihui
    Zhou, Qin
    Ma, Andy Guo
    Cheng, Peter Xiaopei
    Gao, Yan
    [J]. 2014 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2014,
12345