Temporal Driver Action Localization using Action Classification Methods

被引:2
|
作者
Alyahya, Munirah [1 ]
Alghannam, Shahad [1 ]
Alhussan, Taghreed [1 ]
机构
[1] Saudi Technol & Secur Comprehens Control Co, Riyadh, Saudi Arabia
关键词
D O I
10.1109/CVPRW56347.2022.00375
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Driver distraction recognition is an essential computer vision task that can play a key role in increasing traffic safety and reducing traffic accidents. In this paper, we propose a temporal driver action localization (TDAL) framework for classifying driver distraction actions, as well as identifying the start and end time of a given driver action. The TDAL framework consists of three stages: preprocessing, 'which takes untrimmed video as input and generates multiple clips; action classification, which classifies the clips; and finally, the classifier output is sent to the temporal action localization to generate the start and end times of the distracted actions. The proposed framework achieves an F1 score of 27.06% on Track 3A2 dataset of NVIDIA AI City 2022 Challenge. The findings show that the TDAL framework contributes to fine-grained driver distraction recognition and paves the way for the development of smart and safe transportation. Code will be available soon.
引用
收藏
页码:3318 / 3325
页数:8
相关论文
共 50 条
  • [31] Weakly supervised temporal action localization: a survey
    Li, Ronglu
    Zhang, Tianyi
    Zhang, Rubo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (32) : 78361 - 78386
  • [32] Graph Convolutional Networks for Temporal Action Localization
    Zeng, Runhao
    Huang, Wenbing
    Tan, Mingkui
    Rong, Yu
    Zhao, Peilin
    Huang, Junzhou
    Gan, Chuang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7093 - 7102
  • [33] DANet: Temporal Action Localization with Double Attention
    Sun, Jianing
    Wu, Xuan
    Xiao, Yubin
    Wu, Chunguo
    Liang, Yanchun
    Liang, Yi
    Wang, Liupu
    Zhou, You
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [34] Temporal Action Localization by Structured Maximal Sums
    Yuan, Zehuan
    Stroud, Jonathan C.
    Lu, Tong
    Deng, Jia
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3215 - 3223
  • [35] Action recognition and localization with spatial and temporal contexts
    Xu, Wanru
    Miao, Zhenjiang
    Yu, Jian
    Ji, Qiang
    NEUROCOMPUTING, 2019, 333 : 351 - 363
  • [36] Probabilistic Temporal Modeling for Unintentional Action Localization
    Xu, Jinglin
    Chen, Guangyi
    Zhou, Nuoxing
    Zheng, Wei-Shi
    Lu, Jiwen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3081 - 3094
  • [37] Gaussian Temporal Awareness Networks for Action Localization
    Long, Fuchen
    Yao, Ting
    Qiu, Zhaofan
    Tian, Xinmei
    Luo, Jiebo
    Mei, Tao
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 344 - 353
  • [38] Action Shuffling for Weakly Supervised Temporal Localization
    Zhang, Xiao-Yu
    Shi, Haichao
    Li, Changsheng
    Shi, Xinchu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4447 - 4457
  • [39] Dual relation network for temporal action localization
    Xia, Kun
    Wang, Le
    Zhou, Sanping
    Hua, Gang
    Tang, Wei
    PATTERN RECOGNITION, 2022, 129
  • [40] Temporal Dropout for Weakly Supervised Action Localization
    Xie, Chi
    Zhuang, Zikun
    Zhao, Shengjie
    Liang, Shuang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (03)