Traffic Network Flow Prediction Using Parallel Training for Deep Convolutional Neural Networks on Spark Cloud

被引:32
|
作者
Zhang, Yongnan [1 ]
Zhou, Yonghua [1 ]
Lu, Huapu [2 ]
Fujita, Hamido [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Tsinghua Univ, Inst Transportat Engn, Beijing 100084, Peoples R China
[3] Iwate Prefectural Univ, Fac Software & Informat Sci, Takizawa 0200193, Japan
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Training; Predictive models; Data models; Feature extraction; Computational modeling; Cloud computing; Prediction algorithms; Deep convolutional neural networks (DCNNs); parallel training; Spark cloud computing; traffic big data; traffic network flow prediction; SYSTEM; MODEL; SVR;
D O I
10.1109/TII.2020.2976053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic flow in a road network is mutually interactive and interdependent with each other. It is challenging to describe the dynamics of traffic network flow by using analytical methods. In this article, the deep convolutional neural network (DCNN) model is employed to address traffic network flow prediction. To improve the parameter learning efficiency confronting traffic big data, a parallel training approach is developed for the DCNN prediction model. The theoretical foundation is developed for the parallel training algorithm of the DCNN model. A master-slave parallel computing solution for traffic network flow prediction is implemented on the Spark cloud. Real data of traffic network flow are applied to verify the effectiveness of the DCNN prediction model and the parallel training algorithm. The experimental results demonstrate that the DCNN prediction model for traffic network flow outperforms the typical prediction models based on backpropagation neural networks, support vector regressions, radial basis functions, and decision tree regressions. The proposed parallel training method can improve the training efficiency and obtain global features of the entire dataset from local learning with regard to the respective data subsets.
引用
收藏
页码:7369 / 7380
页数:12
相关论文
共 50 条
  • [31] A Convolutional Neural Network Combined with a Gaussian Process for Speed Prediction in Traffic Networks
    Zhu, Yifei
    Wang, Peng
    Mihaylova, Lyudmila
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2021,
  • [32] Deep Convolutional Neural Network for Indoor Regional Crowd Flow Prediction
    Teng, Qiaoshuang
    Sun, Shangyu
    Song, Weidong
    Bei, Jinzhong
    Wang, Chongchang
    ELECTRONICS, 2024, 13 (01)
  • [33] Classifying Malware Traffic Using Images and Deep Convolutional Neural Network
    Davis Jr, R. E.
    Xu, Jingsheng
    Roy, Kaushik
    IEEE ACCESS, 2024, 12 : 58031 - 58038
  • [34] Prediction of Road Traffic Flow Based on Deep Recurrent Neural Networks
    Bartlett, Zoe
    Han, Liangxiu
    Trung Thanh Nguyen
    Johnson, Princy
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 102 - 109
  • [35] Prediction of aerodynamic flow fields using convolutional neural networks
    Saakaar Bhatnagar
    Yaser Afshar
    Shaowu Pan
    Karthik Duraisamy
    Shailendra Kaushik
    Computational Mechanics, 2019, 64 : 525 - 545
  • [36] Prediction of aerodynamic flow fields using convolutional neural networks
    Bhatnagar, Saakaar
    Afshar, Yaser
    Pan, Shaowu
    Duraisamy, Karthik
    Kaushik, Shailendra
    COMPUTATIONAL MECHANICS, 2019, 64 (02) : 525 - 545
  • [37] Real-Time Vehicle Traffic Prediction in Apache Spark Using Ensemble Learning for Deep Neural Networks
    Sundareswaran, Anveshrithaa
    Lavanya, K.
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2020, 16 (04) : 19 - 36
  • [38] Neural network ensembles and their application to traffic flow prediction in telecommunications networks
    Xin, Y
    Fischer, M
    Brown, G
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 693 - 698
  • [39] Network traffic prediction using ARIMA and neural networks models
    Rutka, G.
    ELEKTRONIKA IR ELEKTROTECHNIKA, 2008, (04) : 47 - 52
  • [40] Applying Deep Convolutional Neural Network (DCNN) Algorithm in the Cloud Autonomous Vehicles Traffic Model
    Ramakrishnan, Dhaya
    Radhakrishnan, Kanthavel
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2022, 19 (02) : 186 - 194