EVENT AND ACTIVITY RECOGNITION IN AERIAL VIDEOS USING DEEP NEURAL NETWORKS AND A NEW DATASET

被引:3
|
作者
Mou, Lichao [1 ,2 ]
Hua, Yuansheng [1 ,2 ]
Jin, Pu [3 ]
Zhu, Xiao Xiang [1 ,2 ]
机构
[1] German Aerosp Ctr DLR, Remote Sensing Technol Inst IMF, Cologne, Germany
[2] Tech Univ Munich TUM, Signal Proc Earth Observat SiPEO, Munich, Germany
[3] Tech Univ Munich TUM, Munich, Germany
关键词
Unmanned aerial vehicle (UAV) video; deep learning; event recognition; activity recognition;
D O I
10.1109/IGARSS39084.2020.9324182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles (UAVs) are now widespread available. Yet the more UAVs there are in the skies, the more video data they create. It is unrealistic for humans to screen such big data and understand their contents. Hence methodological research on UAV video content understanding is of great importance. In this paper, we introduce a novel task of event recognition in unconstrained aerial videos in the remote sensing community and present a dataset for this task. Organized in a rich semantic taxonomy, the proposed dataset covers a wide range of events involving diverse environments and scales. We report results of plenty of deep networks in two ways: single-frame classification and video classification. The dataset and trained models can be downloaded from https://1cmou.github.i0/ERA_Dataset/.
引用
收藏
页码:952 / 955
页数:4
相关论文
共 50 条
  • [41] Robustness guarantees for deep neural networks on videos
    Wu, Min
    Kwiatkowska, Marta
    Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2020, : 308 - 317
  • [42] DEEP NETWORKS FOR AUDIO EVENT CLASSIFICATION IN SOCCER VIDEOS
    Ballan, Lamberto
    Bazzica, Alessio
    Bertini, Marco
    Del Bimbo, Alberto
    Serra, Giuseppe
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 474 - 477
  • [43] Human activity recognition using neural networks
    Oniga, Stefan
    Sueto, Jozsef
    2014 15TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2014, : 403 - 406
  • [44] Robustness Guarantees for Deep Neural Networks on Videos
    Wu, Min
    Kwiatkowska, Marta
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 308 - 317
  • [45] NorFisk: fish image dataset from Norwegian fish farms for species recognition using deep neural networks
    Crescitelli, A. M.
    Gansel, L. C.
    Zhang, H.
    MODELING IDENTIFICATION AND CONTROL, 2021, 42 (01) : 1 - 16
  • [46] Human motion activity recognition and pattern analysis using compressed deep neural networks
    Kumari, Navita
    Yadagani, Amulya
    Behera, Basudeba
    Semwal, Vijay Bhaskar
    Mohanty, Somya
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2024, 12 (01):
  • [47] Deep Sensing: Inertial and Ambient Sensing for Activity Context Recognition Using Deep Convolutional Neural Networks
    Otebolaku, Abayomi
    Enamamu, Timibloudi
    Alfoudi, Ali
    Ikpehai, Augustine
    Marchang, Jims
    Lee, Gyu Myoung
    SENSORS, 2020, 20 (13) : 1 - 25
  • [48] Human Activity Recognition Using Smartphone Sensor Data Via Deep Neural Networks
    Chen, Yuwen
    Zhong, Kunhua
    2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING APPLICATIONS (CSEA 2015), 2015, : 348 - 353
  • [49] Using COVID-19 Masks Dataset to Implement Deep Convolutional Neural Networks For Facial Emotion Recognition
    Tegani, Salem
    Abdelmoutia, Telli
    2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [50] Barley disease recognition using deep neural networks
    Rezaei, Masoud
    Gupta, Sanjiv
    Diepeveen, Dean
    Laga, Hamid
    Jones, Michael G. K.
    Sohel, Ferdous
    EUROPEAN JOURNAL OF AGRONOMY, 2024, 161