Laboratory Abnormal Behavior Detection Based on Multimodal Information Fusion

被引:0
|
作者
Zhang, Dawei [1 ]
机构
[1] Liaodong Univ, Sch Informat Engn, Liaodong, Peoples R China
关键词
Multimodal Information Fusion; Optical Flow Theory; Abnormal Behavior Detection; Motion Mode Information; Contour Modal Information;
D O I
10.4018/IJDCF.350265
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The traditional laboratory anomaly detection methods mainly focus on the hidden dangers caused by chemical leaks and other items, ignoring the impact of abnormal behaviors such as incorrect operations and improper behavior on safety in the laboratory. This paper proposes a laboratory abnormal behavior detection method based on multimodal information fusion. The method generates a dense optical flow field of RGB image sequences based on optical flow theory and global smoothing constraints, and mines motion mode information. Meanwhile, the contour modal information of behavior is captured through convolution and adjacency matrix operations. Using decision level and proximity functions to integrate student behavior motion mode information and contour mode information, and using the maximum value as the behavior detection result. The experimental results show that the method can effectively detect abnormal behavior in the laboratory environment, with small detection errors and a specificity close to 1.00, effectively ensuring the safety of the laboratory environment.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] A Dynamic Weighted Multimodal Fusion Fake Information Detection Method
    Zuo, Lulan
    Zhang, Zhiyong
    Wang, Jian
    Sangaiah, Arun Kumar
    [J]. Human-centric Computing and Information Sciences, 2024, 14
  • [22] Abnormal Behavior Recognition Based on features Fusion
    Tao, Yu
    Wei, Yongchao
    [J]. MANUFACTURING PROCESS AND EQUIPMENT, PTS 1-4, 2013, 694-697 : 1949 - 1952
  • [23] MRLab: Virtual-Reality Fusion Smart Laboratory Based on Multimodal Fusion
    Wang, Hongyue
    Feng, Zhiquan
    Yang, Xiaohui
    Zhou, Liran
    Tian, Jinglan
    Guo, Qingbei
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024, 40 (08) : 1975 - 1988
  • [24] Feature-Fusion-Based Abnormal-Behavior-Detection Method in Virtualization Environment
    Zheng, Luxin
    Zhang, Jian
    Lin, Faxin
    Wang, Xiangyi
    [J]. ELECTRONICS, 2023, 12 (16)
  • [25] Learning-Based Multimodal Information Fusion and Behavior Recognition of Vascular Interventionists' Operating Skills
    Wang, Shuang
    Liu, Zheng
    Yang, Wentuo
    Cao, Yongfeng
    Zhao, Liang
    Xie, Le
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (09) : 4536 - 4547
  • [26] Multimodal information fusion based human movement recognition
    Shu, Yao
    Zhang, Heng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (7-8) : 5043 - 5052
  • [27] Warehouse AGV Navigation Based on Multimodal Information Fusion
    Zhang Bo
    Zhang Yinlong
    Liang Wei
    Wang Xin
    Yang Yutuo
    [J]. ACTA OPTICA SINICA, 2024, 44 (09)
  • [28] An Intention Understanding Algorithm Based on Multimodal Information Fusion
    Dou, Shaosong
    Feng, Zhiquan
    Tian, Jinglan
    Fan, Xue
    Hou, Ya
    Zhang, Xin
    [J]. SCIENTIFIC PROGRAMMING, 2021, 2021
  • [29] An Intention Understanding Algorithm Based on Multimodal Information Fusion
    Dou, Shaosong
    Feng, Zhiquan
    Tian, Jinglan
    Fan, Xue
    Hou, Ya
    Zhang, Xin
    [J]. Scientific Programming, 2021, 2021
  • [30] Multimodal information fusion based human movement recognition
    Yao Shu
    Heng Zhang
    [J]. Multimedia Tools and Applications, 2020, 79 : 5043 - 5052