Exploration on multimodal data recognition method for Internet of Things based on deep learning

被引:0
|
作者
Zheng, Xuan [1 ,2 ]
Sun, Zheng [1 ]
机构
[1] Gannan Med Univ, Coll Med Informat Engn, Ganzhou 314000, Jiangxi, Peoples R China
[2] Zhejiang Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Multimodal data recognition method; deep learning; internet of things; long short term memory network technology; data recognition and optimization processing;
D O I
10.3233/IDT-230267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of Internet of Things (IoT) technology, a large amount of sensor data, images, voice, and other data are being widely used, bringing new opportunities for intelligent and cross-domain information fusion. Effective feature extraction and accurate recognition remain urgent issues to be addressed. This article explores the application of deep learning (DL) in multimodal data recognition methods of the IoT and proposes path optimization for multimodal data recognition methods of the IoT under DL. This article also provides in-depth analysis and discussion on the optimization of multimodal data recognition models based on DL, as well as specific measures for optimizing the path of multimodal data recognition based on DL. In this paper, the long short-term memory (LSTM) technology is introduced, and the LSTM technology is used to optimize the multi-modal data recognition method. It can be seen from the comparison that the processing efficiency of data analysis, information fusion, speech recognition, and emotion analysis of the multimodal data recognition method optimized by LSTM technology is 0.29, 0.35, 0.31, and 0.24 higher, respectively, than that of data analysis, information fusion, speech recognition, and emotion analysis before optimization. Introducing DL methods in multimodal data recognition of the IoT can effectively improve the effectiveness of data recognition and fusion and achieve higher levels of recognition for speech recognition and sentiment analysis.
引用
收藏
页码:759 / 767
页数:9
相关论文
共 50 条
  • [11] Channel state information acquisition method of internet of things based on deep learning
    Zhang, Chen
    JOURNAL OF ENGINEERING-JOE, 2021, 2021 (12): : 838 - 848
  • [12] Thinking and exploration of the teaching mode of empirical accounting course based on the Internet of Things and deep learning
    Yang, Shengyi
    Zhu, Shaoying
    INTERNATIONAL JOURNAL OF NETWORK MANAGEMENT, 2024, 34 (01)
  • [13] Deep Learning for the Internet of Things
    Yao, Shuochao
    Zhao, Yiran
    Zhang, Aston
    Hu, Shaohan
    Shao, Huajie
    Zhang, Chao
    Su, Lu
    Abdelzaher, Tarek
    COMPUTER, 2018, 51 (05) : 32 - 41
  • [14] A Massive Multi-Modal Perception Data Classification Method Using Deep Learning Based on Internet of Things
    Jiang, Linli
    Wu, Chunmei
    INTERNATIONAL JOURNAL OF WIRELESS INFORMATION NETWORKS, 2020, 27 (02) : 226 - 233
  • [15] A Massive Multi-Modal Perception Data Classification Method Using Deep Learning Based on Internet of Things
    Linli Jiang
    Chunmei Wu
    International Journal of Wireless Information Networks, 2020, 27 : 226 - 233
  • [16] Multistep Deep System for Multimodal Emotion Detection With Invalid Data in the Internet of Things
    Li, Minjia
    Xie, Lun
    Lv, Zeping
    Li, Juan
    Wang, Zhiliang
    IEEE ACCESS, 2020, 8 : 187208 - 187221
  • [17] Robotized application based on deep learning and Internet of Things
    Pascal, Carlos
    Raveica, Laura-Ofelia
    Panescu, Doru
    2018 22ND INTERNATIONAL CONFERENCE ON SYSTEM THEORY, CONTROL AND COMPUTING (ICSTCC), 2018, : 646 - 651
  • [18] A Deep Learning-Based Method for Preventing Data Leakage in Electric Power Industrial Internet of Things Business Data Interactions
    Miao, Weiwei
    Zhao, Xinjian
    Zhang, Yinzhao
    Chen, Shi
    Li, Xiaochao
    Li, Qianmu
    SENSORS, 2024, 24 (13)
  • [19] Deep dynamic face capture and recognition based on internet of things
    Ai, Cunchi
    Lin, Tianqi
    Shi, Wandi
    INTERNET TECHNOLOGY LETTERS, 2023,
  • [20] Deep practice of internet of things image recognition technology based on deep learning in intelligent financial supervision system
    Gao Y.
    Ma R.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 9511 - 9523