Activity Recognition: Translation across Sensor Modalities Using Deep Learning

被引：5

作者：

Okita, Tsuyoshi ^{[1
]}

Inoue, Sozo ^{[1
]}

机构：

[1] Kyushu Inst Technol, 1-1 Sensui Cho, Kitakyushu, Fukuoka 8048550, Japan

来源：

PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT) | 2018年

关键词：

Activity Recognition; Deep Learning; Multi-modality;

D O I：

10.1145/3267305.3267512

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We propose a method to translate between multi-modalities using an RNN encoder-decoder model. Based on such a model allowing to translate between modalities, we built an activity recognition system. The idea of equivalence of modality was investigated by Banos et al. This paper replaces this with deep learning. We compare the performance of translation with/without clustering and sliding window. We show the preliminary performance of activity recognition attained the F1 score of 0.78.

引用

页码：1462 / 1471

页数：10

共 50 条

[31] Analysis of Human Activity Recognition using Deep Learning
Khattar, Lamiyah
Kapoor, Chinmay
Aggarwal, Garima
[J]. 2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, : 100 - 104
[32] Predicting retinal thickness from fundus images across modalities using deep learning
Holmberg, Olle Gottfrid
Kortuem, Karsten Ulrich
Koehler, Niklas
Theis, Fabian
[J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (09)
[33] Multimodal Biometrics Recognition from Facial Video with Missing Modalities Using Deep Learning
Maity, Sayan
Abdel-Mottaleb, Mohamed
Asfour, Shihab S.
[J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2020, 16 (01): : 6 - 29
[34] Activity recognition based on smartphone sensor data using shallow and deep learning techniques: A Comparative Study
Asif Iqbal Middya
Sarvajit Kumar
Sarbani Roy
[J]. Multimedia Tools and Applications, 2024, 83 : 9033 - 9066
[35] Learning from the Best: Contrastive Representations Learning Across Sensor Locations forWearable Activity Recognition
Rey, Vitor Fortes
Suh, Sungho
Lukowicz, Paul
[J]. PROCEEDINGS OF THE 2022 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, ISWC 2022, 2022, : 28 - 32
[36] A comparative analysis on sensor-based human activity recognition using various deep learning techniques
Indumathi, V.
Prabakeran, S.
[J]. Lecture Notes on Data Engineering and Communications Technologies, 2021, 66 : 919 - 938
[37] Activity recognition based on smartphone sensor data using shallow and deep learning techniques: A Comparative Study
Middya, Asif Iqbal
Kumar, Sarvajit
Roy, Sarbani
[J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 9033 - 9066
[38] Activity Recognition using Accelerometer Sensor and Machine Learning Classifiers
Sukor, A. S. Abdull
Zakaria, A.
Rahim, N. Abdul
[J]. 2018 IEEE 14TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2018), 2018, : 233 - 238
[39] Deep learning and model personalization in sensor-based human activity recognition
Ferrari A.
Micucci D.
Mobilio M.
Napoletano P.
[J]. Journal of Reliable Intelligent Environments, 2023, 9 (01) : 27 - 39
[40] Rotation, Translation and Scale Invariant Sign Word Recognition Using Deep Learning
Miah, Abu Saleh Musa
Shin, Jungpil
Hasan, Md Al Mehedi
Rahim, Md Abdur
Okuyama, Yuichi
[J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2023, 44 (03): : 2521 - 2536

← 1 2 3 4 5 →