Exploration on multimodal data recognition method for Internet of Things based on deep learning

被引:0
|
作者
Zheng, Xuan [1 ,2 ]
Sun, Zheng [1 ]
机构
[1] Gannan Med Univ, Coll Med Informat Engn, Ganzhou 314000, Jiangxi, Peoples R China
[2] Zhejiang Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Multimodal data recognition method; deep learning; internet of things; long short term memory network technology; data recognition and optimization processing;
D O I
10.3233/IDT-230267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of Internet of Things (IoT) technology, a large amount of sensor data, images, voice, and other data are being widely used, bringing new opportunities for intelligent and cross-domain information fusion. Effective feature extraction and accurate recognition remain urgent issues to be addressed. This article explores the application of deep learning (DL) in multimodal data recognition methods of the IoT and proposes path optimization for multimodal data recognition methods of the IoT under DL. This article also provides in-depth analysis and discussion on the optimization of multimodal data recognition models based on DL, as well as specific measures for optimizing the path of multimodal data recognition based on DL. In this paper, the long short-term memory (LSTM) technology is introduced, and the LSTM technology is used to optimize the multi-modal data recognition method. It can be seen from the comparison that the processing efficiency of data analysis, information fusion, speech recognition, and emotion analysis of the multimodal data recognition method optimized by LSTM technology is 0.29, 0.35, 0.31, and 0.24 higher, respectively, than that of data analysis, information fusion, speech recognition, and emotion analysis before optimization. Introducing DL methods in multimodal data recognition of the IoT can effectively improve the effectiveness of data recognition and fusion and achieve higher levels of recognition for speech recognition and sentiment analysis.
引用
收藏
页码:759 / 767
页数:9
相关论文
共 50 条
  • [1] Deep Learning in Big Data and Internet of Things
    Tomar, Dimpal
    Tomar, Pradeep
    Kaur, Gurjit
    [J]. INFORMATION, COMMUNICATION AND COMPUTING TECHNOLOGY, ICICCT 2018, 2019, 835 : 70 - 81
  • [2] A Negative Emotion Recognition System with Internet of Things-Based Multimodal Biosignal Data
    Ham, Seung-Mi
    Lee, Hye-Min
    Lim, Jae-Hyun
    Seo, Jeongwook
    [J]. ELECTRONICS, 2023, 12 (20)
  • [3] A Deep Reinforcement Learning Method For Multimodal Data Fusion in Action Recognition
    Guo, Jiale
    Liu, Qiang
    Chen, Enqing
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 120 - 124
  • [4] Deep Learning-based Automatic Modulation Recognition Algorithm in Internet of Things
    Wang, Yu
    Gui, Guan
    Huang, Hao
    Wang, Jie
    Yin, Yue
    Zhou, Tian
    Zhao, Yu
    Sheng, Hong
    Zhu, Xiaomei
    [J]. PROCEEDINGS OF 2019 IEEE 2ND INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION AND COMMUNICATION TECHNOLOGY (ICEICT 2019), 2019, : 576 - 579
  • [5] Deep Learning Based Device Classification Method for Safeguarding Internet of Things
    Luo, Yantian
    Chen, Xu
    Ge, Ning
    Lu, Jianhua
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [6] Analysis of anomaly detection method for Internet of things based on deep learning
    Ma, Wei
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2020, 31 (12)
  • [7] Deep Learning and Internet of Things Based Lung Ailment Recognition Through Coughing Spectrograms
    Kumar, Ajay
    Abhishek, Kumar
    Chakraborty, Chinmay
    Kryvinska, Natalia
    [J]. IEEE ACCESS, 2021, 9 : 95938 - 95948
  • [8] A Data Feature Recognition Method Based On Deep Learning
    Wang, Jintao
    Feng, Guangquan
    Zhao, Long
    Zhang, Lirun
    Xie, Fei
    [J]. 2020 IEEE THE 3RD INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION ENGINEERING (ICECE), 2020, : 140 - 144
  • [9] Federated deep reinforcement learning based secure data sharing for Internet of Things
    Miao, Qinyang
    Lin, Hui
    Wang, Xiaoding
    Hassan, Mohammad Mehedi
    [J]. COMPUTER NETWORKS, 2021, 197
  • [10] Channel state information acquisition method of internet of things based on deep learning
    Zhang, Chen
    [J]. JOURNAL OF ENGINEERING-JOE, 2021, 2021 (12): : 838 - 848