Image segmentation using convolutional neural networks in multi-sensor information fusion

被引:2
|
作者
Zhang, Wenying [1 ]
Dong, Min [1 ]
Jiang, Li [1 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
关键词
Image segmentation; Convolution neural network; Fuzzy neural network; Chaotic quantum deep learning algorithm; Multi-sensor information fusion; MODEL;
D O I
10.1007/s00500-023-09271-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the rapid advancement of artificial intelligence (AI) has revolutionized various industries, with image processing playing an important role in the revolution. AI-powered image analysis has opened up new possibilities in healthcare diagnostics, autonomous navigation, and security surveillance, fuelling demand for sophisticated image-processing solutions. This paper describes an innovative approach to AI image processing that combines multi-sensor data fusion with convolutional neural networks (CNNs) within a fuzzy neural network framework. This integration uses data from various sensors, including cameras, lidar, and radar, to improve the robustness and precision of image analysis and interpretation. The T-S model serves as the foundation for the information fusion strategy. A comprehensive investigation of deep learning algorithms reveals inherent strengths such as robustness and parallelism. However, it also identifies limitations, particularly in image segmentation tasks, characterized by challenges like premature convergence and prolonged computation times. The paper proposes a quantization technique for deep learning algorithms to address these issues and introduces chaotic optimization to expedite convergence rates. It also presents a novel three-dimensional Otsu threshold segmentation method based on CNNs, which overcomes noise susceptibility in traditional two-dimensional approaches. Integrating Gray morphology and this three-dimensional Otsu threshold segmentation method results in the development of a three-dimensional Gray Otsu model. This model is the basis for designing a fitness function for the CNN algorithm, optimizing its efficacy. Experimental validation demonstrates the proposed algorithm's effectiveness, achieving an impressive 91% accuracy rate while displaying robust noise resistance and versatility. Comparative assessments against other leading AI architectures, including multilayer perceptron, radial basis function network, recurrent neural network, and long short-term memory network, affirm the superior performance achieved by the proposed approach.
引用
收藏
页码:18353 / 18372
页数:20
相关论文
共 50 条
  • [1] Image segmentation using convolutional neural networks in multi-sensor information fusion
    Wenying Zhang
    Min Dong
    Li Jiang
    [J]. Soft Computing, 2023, 27 : 18353 - 18372
  • [2] Swallow segmentation with artificial neural networks and multi-sensor fusion
    Lee, Joon
    Steele, Catriona M.
    Chau, Tom
    [J]. MEDICAL ENGINEERING & PHYSICS, 2009, 31 (09) : 1049 - 1055
  • [3] The equivalence of Bayesian multi-sensor information fusion and neural networks
    Aarabi, P
    [J]. SENSOR FUSION: ARCHITECTURES, ALGORITHMS AND APPLICATIONS V, 2001, 4385 : 67 - 76
  • [4] IMU-Based Gait Recognition Using Convolutional Neural Networks and Multi-Sensor Fusion
    Dehzangi, Omid
    Taherisadr, Mojtaba
    ChangalVala, Raghvendar
    [J]. SENSORS, 2017, 17 (12)
  • [5] FALL DETECTION USING CONVOLUTIONAL NEURAL NETWORK WITH MULTI-SENSOR FUSION
    Zhou, Xu
    Qian, Li-Chang
    You, Peng-Jie
    Ding, Ze-Gang
    Han, Yu-Qi
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
  • [6] A Multi-Sensor Fusion Framework Based on Coupled Residual Convolutional Neural Networks
    Li, Hao
    Ghamisi, Pedram
    Rasti, Behnood
    Wu, Zhaoyan
    Shapiro, Aurelie
    Schultz, Michael
    Zipf, Alexander
    [J]. REMOTE SENSING, 2020, 12 (12)
  • [7] FusionLane: Multi-Sensor Fusion for Lane Marking Semantic Segmentation Using Deep Neural Networks
    Yin, Ruochen
    Cheng, Yong
    Wu, Huapeng
    Song, Yuntao
    Yu, Biao
    Niu, Runxin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) : 1543 - 1553
  • [8] The Research on Fuzzy Neural Networks in the Multi-Sensor Information Fusion of Intelligent Robots
    Hu, Lian-jun
    Song, Hong
    Luo, Yi
    Zeng, Xiaohui
    Wang, Bingqiang
    [J]. ADVANCED RESEARCH ON AUTOMATION, COMMUNICATION, ARCHITECTONICS AND MATERIALS, PTS 1 AND 2, 2011, 225-226 (1-2): : 115 - +
  • [9] Drivers' Mental Engagement Analysis Using Multi-Sensor Fusion Approaches Based on Deep Convolutional Neural Networks
    Najafi, Taraneh Aminosharieh
    Affanni, Antonio
    Rinaldo, Roberto
    Zontone, Pamela
    [J]. SENSORS, 2023, 23 (17)
  • [10] Aeroengine Bearing Fault Diagnosis Based on Convolutional Neural Network for Multi-sensor Information Fusion
    Yang J.
    Wan A.
    Wang J.
    Shan T.
    Miao X.
    Li K.
    Zuo Q.
    [J]. Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (13): : 4933 - 4941