Activity Recognition: Translation across Sensor Modalities Using Deep Learning

被引:5
|
作者
Okita, Tsuyoshi [1 ]
Inoue, Sozo [1 ]
机构
[1] Kyushu Inst Technol, 1-1 Sensui Cho, Kitakyushu, Fukuoka 8048550, Japan
关键词
Activity Recognition; Deep Learning; Multi-modality;
D O I
10.1145/3267305.3267512
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method to translate between multi-modalities using an RNN encoder-decoder model. Based on such a model allowing to translate between modalities, we built an activity recognition system. The idea of equivalence of modality was investigated by Banos et al. This paper replaces this with deep learning. We compare the performance of translation with/without clustering and sliding window. We show the preliminary performance of activity recognition attained the F1 score of 0.78.
引用
收藏
页码:1462 / 1471
页数:10
相关论文
共 50 条
  • [1] Activity Recognition Using Different Sensor Modalities and Deep Learning
    Ascioglu, Gokmen
    Senol, Yavuz
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [2] Deep Convolutional Feature Transfer Across Mobile Activity Recognition Domains, Sensor Modalities and Locations
    Morales, Francisco Javier Ordonez
    Roggen, Daniel
    [J]. ISWC'16 - PROCEEDINGS OF THE 2016 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2016, : 92 - 99
  • [3] Sensor Positioning and Data Acquisition for Activity Recognition using Deep Learning
    Chung, Seungeun
    Lim, Jiyoun
    Noh, Kyoung Ju
    Kim, Ga Gue
    Jeong, Hyun Tae
    [J]. 2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 154 - 159
  • [4] Kinect=IMU? Learning MIMO Signal Mappings to Automatically Translate Activity Recognition Systems Across Sensor Modalities
    Banos, Oresti
    Calatroni, Alberto
    Damas, Miguel
    Pomares, Hector
    Rojas, Ignacio
    Sagha, Hesam
    Millan, Jose del R.
    Troester, Gerhard
    Chavarriaga, Ricardo
    Roggen, Daniel
    [J]. 2012 16TH INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (ISWC), 2012, : 92 - 99
  • [5] FMCW Radar Sensor Based Human Activity Recognition using Deep Learning
    Ahmed, Shahzad
    Park, Junbyung
    Cho, Sung Ho
    [J]. 2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [6] Human Activity Recognition from Body Sensor Data using Deep Learning
    Mohammad Mehedi Hassan
    Shamsul Huda
    Md Zia Uddin
    Ahmad Almogren
    Majed Alrubaian
    [J]. Journal of Medical Systems, 2018, 42
  • [7] Human Activity Recognition from Body Sensor Data using Deep Learning
    Hassan, Mohammad Mehedi
    Huda, Shamsul
    Uddin, Md Zia
    Almogren, Ahmad
    Alrubaian, Majed
    [J]. JOURNAL OF MEDICAL SYSTEMS, 2018, 42 (06)
  • [8] A Seismic Sensor based Human Activity Recognition Framework using Deep Learning
    Choudhary, Priyankar
    Goel, Neeraj
    Saini, Mukesh
    [J]. 2021 17TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2021), 2021,
  • [9] Sensor-based Activity Recognition using Deep Learning: A Comparative Study
    Trabelsi, Imen
    Francoise, Jules
    Bellik, Yacine
    [J]. PROCEEDINGS OF 2022 8TH INTERNATIONAL CONFERENCE ON MOVEMENT AND COMPUTING, MOCO 2022, 2022,
  • [10] Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning
    Chung, Seungeun
    Lim, Jiyoun
    Noh, Kyoung Ju
    Kim, Gague
    Jeong, Hyuntae
    [J]. SENSORS, 2019, 19 (07)