Exploration on multimodal data recognition method for Internet of Things based on deep learning

被引:0
|
作者
Zheng, Xuan [1 ,2 ]
Sun, Zheng [1 ]
机构
[1] Gannan Med Univ, Coll Med Informat Engn, Ganzhou 314000, Jiangxi, Peoples R China
[2] Zhejiang Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Multimodal data recognition method; deep learning; internet of things; long short term memory network technology; data recognition and optimization processing;
D O I
10.3233/IDT-230267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of Internet of Things (IoT) technology, a large amount of sensor data, images, voice, and other data are being widely used, bringing new opportunities for intelligent and cross-domain information fusion. Effective feature extraction and accurate recognition remain urgent issues to be addressed. This article explores the application of deep learning (DL) in multimodal data recognition methods of the IoT and proposes path optimization for multimodal data recognition methods of the IoT under DL. This article also provides in-depth analysis and discussion on the optimization of multimodal data recognition models based on DL, as well as specific measures for optimizing the path of multimodal data recognition based on DL. In this paper, the long short-term memory (LSTM) technology is introduced, and the LSTM technology is used to optimize the multi-modal data recognition method. It can be seen from the comparison that the processing efficiency of data analysis, information fusion, speech recognition, and emotion analysis of the multimodal data recognition method optimized by LSTM technology is 0.29, 0.35, 0.31, and 0.24 higher, respectively, than that of data analysis, information fusion, speech recognition, and emotion analysis before optimization. Introducing DL methods in multimodal data recognition of the IoT can effectively improve the effectiveness of data recognition and fusion and achieve higher levels of recognition for speech recognition and sentiment analysis.
引用
收藏
页码:759 / 767
页数:9
相关论文
共 50 条
  • [41] Explainable Deep Learning-Based Feature Selection and Intrusion Detection Method on the Internet of Things
    Chen, Xuejiao
    Liu, Minyao
    Wang, Zixuan
    Wang, Yun
    SENSORS, 2024, 24 (16)
  • [42] A Deep Learning-Based Microgrid Energy Management Method Under the Internet of Things Architecture
    Guo, Wei
    Sun, Shengbo
    Tao, Peng
    Li, Fei
    Ding, Jianyong
    Li, Hongbo
    INTERNATIONAL JOURNAL OF GAMING AND COMPUTER-MEDIATED SIMULATIONS, 2024, 16 (01)
  • [43] A Deep Learning Fusion Recognition Method Based On SAR Image Data
    Zhai Jia
    Dong Guangchang
    Chen Feng
    Xie Xiaodan
    Qi Chengming
    Li Lin
    2018 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION AND KNOWLEDGE IN THE INTERNET OF THINGS, 2019, 147 : 533 - 541
  • [44] Deep learning and machine learning based anomaly detection in internet of things environments
    Gokdemir, Ali
    Calhan, Ali
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2022, 37 (04): : 1945 - 1956
  • [45] Multimodal data for behavioural authentication in Internet of Things environments
    Krasovec, Andraz
    Baldini, Gianmarco
    Pejovic, Veljko
    DATA IN BRIEF, 2024, 55
  • [46] Device Clustering Algorithm Based on Multimodal Data Correlation in Cognitive Internet of Things
    Lin, Kai
    Wang, Di
    Xia, Fuzhen
    Ge, Hongwei
    IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (04): : 2263 - 2271
  • [47] A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition
    Yu, Mingyang
    Xu, Haiqing
    Zhou, Fangliang
    Xu, Shuai
    Yin, Hongling
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2023, 12 (12)
  • [48] Learning behaviour recognition method of English online course based on multimodal data fusion
    Li, Liangjie
    International Journal of Business Intelligence and Data Mining, 2024, 25 (3-4) : 336 - 349
  • [49] A Multimodal Biometric Recognition Method Based on Federated Learning
    Chen, Guang
    Luo, Dacan
    Lian, Fengzhao
    Tian, Feng
    Yang, Xu
    Kang, Wenxiong
    IET Biometrics, 2024, 2024 (01)
  • [50] Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach
    Wang, Yang
    Gao, Zhen
    Zhang, Jun
    Cao, Xianbin
    Zheng, Dezhi
    Gao, Yue
    Ng, Derrick Wing Kwan
    Renzo, Marco Di
    IEEE Internet of Things Journal, 2022, 9 (05): : 3899 - 3912