EVENT AND ACTIVITY RECOGNITION IN AERIAL VIDEOS USING DEEP NEURAL NETWORKS AND A NEW DATASET

被引:3
|
作者
Mou, Lichao [1 ,2 ]
Hua, Yuansheng [1 ,2 ]
Jin, Pu [3 ]
Zhu, Xiao Xiang [1 ,2 ]
机构
[1] German Aerosp Ctr DLR, Remote Sensing Technol Inst IMF, Cologne, Germany
[2] Tech Univ Munich TUM, Signal Proc Earth Observat SiPEO, Munich, Germany
[3] Tech Univ Munich TUM, Munich, Germany
关键词
Unmanned aerial vehicle (UAV) video; deep learning; event recognition; activity recognition;
D O I
10.1109/IGARSS39084.2020.9324182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles (UAVs) are now widespread available. Yet the more UAVs there are in the skies, the more video data they create. It is unrealistic for humans to screen such big data and understand their contents. Hence methodological research on UAV video content understanding is of great importance. In this paper, we introduce a novel task of event recognition in unconstrained aerial videos in the remote sensing community and present a dataset for this task. Organized in a rich semantic taxonomy, the proposed dataset covers a wide range of events involving diverse environments and scales. We report results of plenty of deep networks in two ways: single-frame classification and video classification. The dataset and trained models can be downloaded from https://1cmou.github.i0/ERA_Dataset/.
引用
收藏
页码:952 / 955
页数:4
相关论文
共 50 条
  • [1] LEARNING DEEP TRAJECTORY DESCRIPTOR FOR ACTION RECOGNITION IN VIDEOS USING DEEP NEURAL NETWORKS
    Shi, Yemin
    Zeng, Wei
    Huang, Tiejun
    Wang, Yaowei
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
  • [2] Abnormal Event Detection in Videos Based on Deep Neural Networks
    Ma, Qinmin
    SCIENTIFIC PROGRAMMING, 2021, 2021
  • [3] HUMAN ACTIVITY DETECTION AND ACTION RECOGNITION IN VIDEOS USING CONVOLUTIONAL NEURAL NETWORKS
    Basavaiah, Jagadeesh
    Patil, Chandrashekar Mohan
    JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY-MALAYSIA, 2020, 19 (02): : 157 - 183
  • [4] Parallelizing Convolutional Neural Networks for Action Event Recognition in Surveillance Videos
    Wang, Qicong
    Zhao, Jinhao
    Gong, Dingxi
    Shen, Yehu
    Li, Maozhen
    Lei, Yunqi
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2017, 45 (04) : 734 - 759
  • [5] Parallelizing Convolutional Neural Networks for Action Event Recognition in Surveillance Videos
    Qicong Wang
    Jinhao Zhao
    Dingxi Gong
    Yehu Shen
    Maozhen Li
    Yunqi Lei
    International Journal of Parallel Programming, 2017, 45 : 734 - 759
  • [6] Multiview fusion for activity recognition using deep neural networks
    Kavi, Rahul
    Kulathumani, Vinod
    Rohit, Fnu
    Kecojevic, Vlad
    JOURNAL OF ELECTRONIC IMAGING, 2016, 25 (04)
  • [7] Artificial neural networks for human activity recognition using sensor based dataset
    Geravesh, Shahab
    Rupapara, Vaibhav
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (10) : 14815 - 14835
  • [8] Artificial neural networks for human activity recognition using sensor based dataset
    Shahab Geravesh
    Vaibhav Rupapara
    Multimedia Tools and Applications, 2023, 82 : 14815 - 14835
  • [9] Analysis of Deep Neural Networks for Human Activity Recognition in Videos-A Systematic Literature Review
    Ullah, Hadiqa Aman
    Letchmunan, Sukumar
    Zia, M. Sultan
    Butt, Umair Muneer
    Hassan, Fadratul Hafinaz
    IEEE ACCESS, 2021, 9 : 126366 - 126387
  • [10] Human Activity Recognition in Videos Using Deep Learning
    Kumar, Mohit
    Rana, Adarsh
    Ankita
    Yadav, Arun Kumar
    Yadav, Divakar
    SOFT COMPUTING AND ITS ENGINEERING APPLICATIONS, ICSOFTCOMP 2022, 2023, 1788 : 288 - 299