A Multi-Stream Approach to Mixed-Traffic Accident Recognition Using Deep Learning

被引:0
|
作者
Fu, Swee Tee [1 ]
Theng, Lau Bee [1 ]
Shiong, Brian Loh Chung [1 ]
Mccarthy, Chris [2 ]
Tsun, Mark Tee Kit [1 ]
机构
[1] Swinburne University of Technology, Faculty of Engineering, Computing and Science, Sarawak,Sarawak Campus, Kuching,93350, Malaysia
[2] Swinburne University of Technology, School of Science, Computing and Engineering Technologies (SoSCET), Melbourne Campus, Hawthorn,VIC,3122, Australia
关键词
Road traffic accidents are a leading cause of injuries and fatalities globally; prompting extensive research into deep learning-based accident recognition models for their superior performance in computer vision tasks. However; most studies focus on non-mixed traffic environments; where detection is simpler due to predictable traffic patterns and uniform vehicle types. In contrast; mixed-traffic scenarios present greater challenges as diverse vehicles; motorcyclists; and pedestrians move unpredictably. Models relying on a single type of perception are effective in structured traffic but struggle to handle the complexities of mixed-traffic environments. This study proposes a novel multi-stream deep learning model called Accident Recognition in Mixed-Traffic Scene (ARMS); which integrates three distinct streams: the first stream analyzes the overall accident scene; the second focuses on mixed-traffic accident features; and the third examines vehicle motion abnormalities through object detection and tracking; aimed at improving road accident recognition accuracy in mixed-traffic environments at intersections. This model is trained and evaluated using datasets from CADP; UA-DETRAC; and supplementary online sources. The results demonstrate that the ARMS model achieves an accuracy of 93.3%; with performance improving significantly through the fusion of the individual streams. Additionally; the ARMS model was evaluated using two publicly available standard datasets; which further highlights its improved performance in recognizing mixed-traffic accidents compared to existing studies. © 2013 IEEE;
D O I
10.1109/ACCESS.2024.3512794
中图分类号
学科分类号
摘要
引用
收藏
页码:185232 / 185249
相关论文
共 50 条
  • [31] Hard-testing the multi-stream approach. to automatic speech recognition
    Pera, V
    Martens, JP
    TEXT, SPEECH AND DIALOGUE, PROCEEDINGS, 2003, 2807 : 315 - 320
  • [32] Automatic Modulation Classification Using a Deep Multi-Stream Neural Network
    Zhang, Hao
    Wang, Yan
    Xu, Lingwei
    Gulliver, T. Aaron
    Cao, Conghui
    IEEE ACCESS, 2020, 8 : 43888 - 43897
  • [33] A Multi-stream Deep Learning Model for EEG-based Depression Identification
    Wu, Hao
    Liu, Jiyao
    Proceedings - 2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022, 2022, : 2029 - 2034
  • [34] Visual Object Tracking Via Multi-Stream Deep Similarity Learning Networks
    Li, Kunpeng
    Kong, Yu
    Fu, Yun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3311 - 3320
  • [35] Multi-Stream Deep Neural Networks for RGB-D Egocentric Action Recognition
    Tang, Yansong
    Wang, Zian
    Lu, Jiwen
    Feng, Jianjiang
    Zhou, Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 3001 - 3015
  • [36] Group-level Cohesion Prediction using Deep Learning Models with A Multi-stream Hybrid Network
    Dang Xuan Tien
    Thanh-Hung Vo
    Yang, Hyung-Jeong
    Lee, Guee-Sang
    Kim, Soo-Hyung
    ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, : 572 - 576
  • [37] A Deep Learning Approach to the Citywide Traffic Accident Risk Prediction
    Ren, Honglei
    Song, You
    Wang, Jingwen
    Hu, Yucheng
    Lei, Jinzhi
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 3346 - 3351
  • [38] Multi-stream Convolutional Networks for Indoor Scene Recognition
    Anwer, Rao Muhammad
    Khan, Fahad Shahbaz
    Laaksonen, Jorma
    Zaki, Nazar
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2019, PT I, 2019, 11678 : 196 - 208
  • [39] SUBBAND HYBRID FEATURE FOR MULTI-STREAM SPEECH RECOGNITION
    Li, Feipeng
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [40] Robust Speaker Recognition Based on Multi-Stream Features
    Wang, Ning
    Wang, Lei
    2016 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-CHINA (ICCE-CHINA), 2016,