Temporal Driver Action Localization using Action Classification Methods

被引:2
|
作者
Alyahya, Munirah [1 ]
Alghannam, Shahad [1 ]
Alhussan, Taghreed [1 ]
机构
[1] Saudi Technol & Secur Comprehens Control Co, Riyadh, Saudi Arabia
关键词
D O I
10.1109/CVPRW56347.2022.00375
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Driver distraction recognition is an essential computer vision task that can play a key role in increasing traffic safety and reducing traffic accidents. In this paper, we propose a temporal driver action localization (TDAL) framework for classifying driver distraction actions, as well as identifying the start and end time of a given driver action. The TDAL framework consists of three stages: preprocessing, 'which takes untrimmed video as input and generates multiple clips; action classification, which classifies the clips; and finally, the classifier output is sent to the temporal action localization to generate the start and end times of the distracted actions. The proposed framework achieves an F1 score of 27.06% on Track 3A2 dataset of NVIDIA AI City 2022 Challenge. The findings show that the TDAL framework contributes to fine-grained driver distraction recognition and paves the way for the development of smart and safe transportation. Code will be available soon.
引用
收藏
页码:3318 / 3325
页数:8
相关论文
共 50 条
  • [41] Temporal Superpixels based Human Action Localization
    Ullah, Sami
    Hassan, Najmul
    Bhatti, Naeem
    2018 14TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES (ICET), 2018,
  • [42] Frame Segmentation Networks for Temporal Action Localization
    Yang, Ke
    Qiao, Peng
    Wang, Qiang
    Li, Shijie
    Niu, Xin
    Li, Dongsheng
    Dou, Yong
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 242 - 252
  • [43] Revisiting Anchor Mechanisms for Temporal Action Localization
    Yang, Le
    Peng, Houwen
    Zhang, Dingwen
    Fu, Jianlong
    Han, Junwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8535 - 8548
  • [44] TVNet: Temporal Voting Network for Action Localization
    Wang, Hanyuan
    Damen, Dima
    Mirmehdi, Majid
    Perrett, Toby
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 550 - 558
  • [45] Action Reinforcement and Indication Module for Single-frame Temporal Action Localization
    Yu, Zikang
    Cheng, Cheng
    Wen, Wujun
    Guo, Wenxuan
    Feng, Lin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [46] APSL: Action-positive separation learning for unsupervised temporal action localization
    Liu, Yuanyuan
    Zhou, Ning
    Zhang, Fayong
    Wang, Wenbin
    Wang, Yu
    Liu, Kejun
    Liu, Ziyuan
    INFORMATION SCIENCES, 2023, 630 : 206 - 221
  • [47] Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localization
    Huang, Linjiang
    Wang, Liang
    Li, Hongsheng
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7982 - 7991
  • [48] Efficient temporal action localization with temporal attention and gaussian weight
    Sun, Mengbo
    Song, Yonghong
    Wang, Hongda
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [49] Exploring Sub-Action Granularity for Weakly Supervised Temporal Action Localization
    Wang, Binglu
    Zhang, Xun
    Zhao, Yongqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 2186 - 2198
  • [50] Co-Occurrence Matters: Learning Action Relation for Temporal Action Localization
    Cao, Congqi
    Wang, Yizhe
    Zhang, Yueran
    Lu, Yue
    Zhang, Xin
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3327 - 3339