EVENT AND ACTIVITY RECOGNITION IN AERIAL VIDEOS USING DEEP NEURAL NETWORKS AND A NEW DATASET

被引:3
|
作者
Mou, Lichao [1 ,2 ]
Hua, Yuansheng [1 ,2 ]
Jin, Pu [3 ]
Zhu, Xiao Xiang [1 ,2 ]
机构
[1] German Aerosp Ctr DLR, Remote Sensing Technol Inst IMF, Cologne, Germany
[2] Tech Univ Munich TUM, Signal Proc Earth Observat SiPEO, Munich, Germany
[3] Tech Univ Munich TUM, Munich, Germany
关键词
Unmanned aerial vehicle (UAV) video; deep learning; event recognition; activity recognition;
D O I
10.1109/IGARSS39084.2020.9324182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles (UAVs) are now widespread available. Yet the more UAVs there are in the skies, the more video data they create. It is unrealistic for humans to screen such big data and understand their contents. Hence methodological research on UAV video content understanding is of great importance. In this paper, we introduce a novel task of event recognition in unconstrained aerial videos in the remote sensing community and present a dataset for this task. Organized in a rich semantic taxonomy, the proposed dataset covers a wide range of events involving diverse environments and scales. We report results of plenty of deep networks in two ways: single-frame classification and video classification. The dataset and trained models can be downloaded from https://1cmou.github.i0/ERA_Dataset/.
引用
收藏
页码:952 / 955
页数:4
相关论文
共 50 条
  • [21] Monument Recognition using Deep Neural Networks
    Gada, Siddhant
    Mehta, Viraj
    Kanchan, Karan
    Jain, Chahat
    Raut, Purva
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMPUTING RESEARCH (ICCIC), 2017, : 645 - 650
  • [22] Face Recognition using Deep Neural Networks
    Dastgiri, Amirhosein
    Jafarinamin, Pouria
    Kamarbaste, Sami
    Gholizade, Mahdi
    JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES, 2019, 14 (03): : 510 - 527
  • [23] Physical Activity Recognition using Deep Transfer Learning with Convolutional Neural Networks
    Ataseven, Berke
    Madani, Alireza
    Semiz, Beren
    Gursoy, M. Emre
    2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 103 - 108
  • [24] Real-time Activity Recognition on Smartphones Using Deep Neural Networks
    Zhang, Licheng
    Wu, Xihong
    Luo, Dingsheng
    IEEE 12TH INT CONF UBIQUITOUS INTELLIGENCE & COMP/IEEE 12TH INT CONF ADV & TRUSTED COMP/IEEE 15TH INT CONF SCALABLE COMP & COMMUN/IEEE INT CONF CLOUD & BIG DATA COMP/IEEE INT CONF INTERNET PEOPLE AND ASSOCIATED SYMPOSIA/WORKSHOPS, 2015, : 1236 - 1242
  • [25] Human activity recognition with smartphone sensors using deep learning neural networks
    Ronao, Charissa Ann
    Cho, Sung-Bae
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 59 : 235 - 244
  • [26] Human Activity Recognition using Wearable Sensors by Deep Convolutional Neural Networks
    Jiang, Wenchao
    Yin, Zhaozheng
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1307 - 1310
  • [27] Deep Recurrent Neural Networks for Human Activity Recognition
    Murad, Abdulmajid
    Pyun, Jae-Young
    SENSORS, 2017, 17 (11)
  • [28] A study of deep neural networks for human activity recognition
    Sansano, Emilio
    Montoliu, Raul
    Belmonte Fernandez, Oscar
    COMPUTATIONAL INTELLIGENCE, 2020, 36 (03) : 1113 - 1139
  • [29] Aeriform in-action: A novel dataset for human action recognition in aerial videos
    Kapoor, Surbhi
    Sharma, Akashdeep
    Verma, Amandeep
    Singh, Sarbjeet
    PATTERN RECOGNITION, 2023, 140
  • [30] Audio Event Classification Using Deep Neural Networks
    Kons, Zvi
    Toledo-Ronen, Orith
    14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 1481 - 1485