Flow data processing paradigm and its application in smart city using a cluster analysis approach

被引:3
|
作者
Zou, Xiang [1 ,2 ]
Cao, Jinghua [2 ,3 ]
Sun, Wei [2 ]
Guo, Quan [2 ]
Wen, Tao [1 ,2 ]
机构
[1] Northeastern Univ, Software Ctr, Shenyang, Liaoning, Peoples R China
[2] Dalian Neusoft Inst Informat, Dalian, Peoples R China
[3] Dalian Maritime Univ, Traff Informat Engn & Control, Dalian, Liaoning, Peoples R China
关键词
Big data; Cluster computing; Distributed processing; Spark; Information mining; BIG DATA; CLOUD;
D O I
10.1007/s10586-018-2839-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the digital revolution era the work style of the people changed into real and live communicative systems. Smart cities are evolved from the smart ecosystem with various domains like healthcare, information exchange, transportation, buildings etc., the presence of multiple information system makes these smart cities into a heterogeneous which includes multiple data transfer based on the large no of interconnected sub systems. Since the systems provide data from various terminals to the host the amount of information generates is same as the chances of increasing the challenges and issues in the smart city. These flow data from various sources are handled using cluster computing and this proposed research provides the data flow in the smart city using cluster computing. Apache spark is the tool used to handle the issues in the smart city which is much better than the Hadoop. The results discuss the comparison between the applications in same environment on both the tools.
引用
收藏
页码:435 / 444
页数:10
相关论文
共 50 条
  • [1] Flow data processing paradigm and its application in smart city using a cluster analysis approach
    Xiang Zou
    Jinghua Cao
    Wei Sun
    Quan Guo
    Tao Wen
    [J]. Cluster Computing, 2019, 22 : 435 - 444
  • [2] Data Processing Method for Public Transport Passenger Flow of the "Smart" City
    Boreiko, Oleh
    Teslyuk, Vasyl
    Baran, Mariana
    Navytka, Mariya
    [J]. 2018 XIVTH INTERNATIONAL CONFERENCE ON PERSPECTIVE TECHNOLOGIES AND METHODS IN MEMS DESIGN (MEMSTECH), 2018, : 61 - 64
  • [3] Traffic Flow Prediction and Application of Smart City Based on Industry 4.0 and Big Data Analysis
    Gong, Yuqian
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [4] VizCluster: An interactive visualization approach to cluster analysis and its application on Microarray data
    Li, Z
    Chun, T
    Yong, S
    Song, YQ
    Zhang, AD
    Ramanathan, M
    [J]. PROCEEDINGS OF THE SECOND SIAM INTERNATIONAL CONFERENCE ON DATA MINING, 2002, : 19 - 40
  • [5] Big Data Processing in Smart City Application Using 6G Driven IoT Framework
    Sun, Maojin
    Sun, Minghui
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2024,
  • [6] Structure Optimization Processing Approach of Geographic Information Data Optimization for Smart City
    Rui, Jiang
    [J]. EDUCATION AND MANAGEMENT INNOVATION, 2017, : 274 - 279
  • [7] Data Processing in IoT for Smart City Systems
    Duda, Oleksij
    Kochan, Volodymyr
    Kunanets, Natalija
    Matsiuk, Oleksandr
    Pasichnyk, Volodymyr
    Sachenko, Anatoliy
    Pytlenko, Taras
    [J]. PROCEEDINGS OF THE 2019 10TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS - TECHNOLOGY AND APPLICATIONS (IDAACS), VOL. 1, 2019, : 96 - 99
  • [8] Big Data Processing Platform for smart city
    El Mendili, Saida
    El Bouzekri El Idrissi, Younes
    Hmina, Nabil
    [J]. 2018 INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2018,
  • [9] Smart City Data Analysis
    Mouchili, Mama Nsangou
    Aljawarneh, Shadi
    Tchouati, Wette
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE, E-LEARNING AND INFORMATION SYSTEMS 2018 (DATA'18), 2018,
  • [10] The application of cluster analysis to the processing of GPS-interferometry data
    V. I. Zakharov
    P. A. Budnikov
    [J]. Moscow University Physics Bulletin, 2012, 67 : 25 - 32