Temporal Driver Action Localization using Action Classification Methods

被引:2
|
作者
Alyahya, Munirah [1 ]
Alghannam, Shahad [1 ]
Alhussan, Taghreed [1 ]
机构
[1] Saudi Technol & Secur Comprehens Control Co, Riyadh, Saudi Arabia
关键词
D O I
10.1109/CVPRW56347.2022.00375
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Driver distraction recognition is an essential computer vision task that can play a key role in increasing traffic safety and reducing traffic accidents. In this paper, we propose a temporal driver action localization (TDAL) framework for classifying driver distraction actions, as well as identifying the start and end time of a given driver action. The TDAL framework consists of three stages: preprocessing, 'which takes untrimmed video as input and generates multiple clips; action classification, which classifies the clips; and finally, the classifier output is sent to the temporal action localization to generate the start and end times of the distracted actions. The proposed framework achieves an F1 score of 27.06% on Track 3A2 dataset of NVIDIA AI City 2022 Challenge. The findings show that the TDAL framework contributes to fine-grained driver distraction recognition and paves the way for the development of smart and safe transportation. Code will be available soon.
引用
收藏
页码:3318 / 3325
页数:8
相关论文
共 50 条
  • [21] Action Coherence Network for Weakly-Supervised Temporal Action Localization
    Zhai, Yuanhao
    Wang, Le
    Tang, Wei
    Zhang, Qilin
    Zheng, Nanning
    Hua, Gang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1857 - 1870
  • [22] Enhancing Temporal Action Localization with Transfer Learning from Action Recognition
    Richard, Alexander
    Iqbal, Ahsan
    Gall, Juergen
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1533 - 1540
  • [23] ACTION RELATIONAL GRAPH FOR WEAKLY-SUPERVISED TEMPORAL ACTION LOCALIZATION
    Cheng, Yi
    Sun, Ying
    Lin, Dongyun
    Lim, Joo-Hwee
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2563 - 2567
  • [24] Action Unit Memory Network for Weakly Supervised Temporal Action Localization
    Luo, Wang
    Zhang, Tianzhu
    Yang, Wenfei
    Liu, Jingen
    Mei, Tao
    Wu, Feng
    Zhang, Yongdong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9964 - 9974
  • [25] Modeling Multi-Label Action Dependencies for Temporal Action Localization
    Tirupattur, Praveen
    Duarte, Kevin
    Rawat, Yogesh S.
    Shah, Mubarak
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1460 - 1470
  • [26] Spatio-temporal action detection and localization using a hierarchical LSTM
    Ramaswamy, Akshaya
    Seemakurthy, Karthik
    Gubbi, Jayavardhana
    Purushothaman, Balamuralidhar
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 3303 - 3312
  • [27] Detecting Eating Behavior of Elephants in a Zoo Using Temporal Action Localization
    Nishioka, Ken
    Noguchi, Wataru
    Izuka, Hiroyuki
    Yamamoto, Masahito
    SENSORS AND MATERIALS, 2023, 35 (11) : 3927 - 3945
  • [28] Temporal Action Localization Using Long Short-Term Dependency
    Zhou, Yuan
    Wang, Ruolin
    Li, Hongru
    Kung, Sun-Yuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 4363 - 4375
  • [29] Weakly Supervised Temporal Action Localization Using Deep Metric Learning
    Islam, Ashraful
    Radke, Richard J.
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 536 - 545
  • [30] Action and Object Interaction Recognition for Driver Activity Classification
    Weyers, Patrick
    Schiebener, David
    Kummert, Anton
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 4336 - 4341