Multi-Source Fusion Image Semantic Segmentation Model of Generative Adversarial Networks Based on FCN

被引:2
|
作者
Zhao, Liang [1 ]
Wang, Ying [1 ]
Duan, Zhongxing [1 ]
Chen, Dengfeng [2 ]
Liu, Shipeng [1 ]
机构
[1] Xian Univ Architecture & Technol, Coll Informat & Control Engn, Xian 710055, Shaanxi, Peoples R China
[2] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Shaanxi, Peoples R China
来源
IEEE ACCESS | 2021年 / 9卷
基金
中国国家自然科学基金;
关键词
Image segmentation; Convolution; Feature extraction; Semantics; Licenses; Image edge detection; Generative adversarial networks; Image semantic segmentation; fully convolutional networks; generative adversarial networks; efficient spatial pyramid; atrous spatial pyramid pooling;
D O I
10.1109/ACCESS.2021.3097054
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, most of the methods used in the research of image semantic segmentation ignore the low-level feature information of image, such as space, edge, etc., which leads to the problems that the segmentation of edge and small part is not precise enough and the accuracy of segmentation result is not high. To solve this problem, this paper proposes a multi-source fusion image semantic segmentation model of generative adversarial networks based on FCN: SCAGAN. In VGG19 network, add super-pixel and edge detection algorithm, and introduce the efficient spatial pyramid module to reduce the number of parameters while adding the spatial and edge information of image; Adjust the skipping structure to better integrate the low-level features and high-level features; build a generation model DeepLab-SCFCN combining with the atrous spatial pyramid pooling to better capture the feature information of different scales of the target for segmentation; The FCN with five modules is designed as the discrimination model for GAN. It is verified on the data set PASCAL VOC 2012 that the model achieves IoU of 70.1% with a small number of network layers, and the segmentation effect of edge and small part is better at the same time. This technology can be used in image semantic segmentation.
引用
收藏
页码:101985 / 101993
页数:9
相关论文
共 50 条
  • [1] Multi-Source Medical Image Fusion Based on Wasserstein Generative Adversarial Networks
    Yang, Zhiguang
    Chen, Youping
    Le, Zhuliang
    Fan, Fan
    Pan, Erting
    [J]. IEEE ACCESS, 2019, 7 : 175947 - 175958
  • [2] A Generative Adversarial Network for Infrared and Visible Image Fusion Based on Semantic Segmentation
    Hou, Jilei
    Zhang, Dazhi
    Wu, Wei
    Ma, Jiayi
    Zhou, Huabing
    [J]. ENTROPY, 2021, 23 (03)
  • [3] Evaluating generative adversarial networks based image-level domain transfer for multi-source remote sensing image segmentation and object detection
    Li, Xue
    Luo, Muying
    Ji, Shunping
    Zhang, Li
    Lu, Meng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (19) : 7327 - 7351
  • [4] Semantic image inpainting based on Generative Adversarial Networks
    Wu, Chugang
    Xian, Yanhua
    Bai, Junqi
    Jing, Yuancheng
    [J]. 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 276 - 280
  • [5] Medical image segmentation method based on multi-source information fusion
    Yang, Chang-Chun
    Ye, Zan-Ting
    Liu, Ban-Teng
    Wang, Ke
    Cui, Hai-Dong
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (02): : 226 - 234
  • [6] Image Semantic Segmentation Based on FCN-CRF Model
    Zhou, Hao
    Zhang, Jun
    Lei, Jun
    Li, Shuohao
    Tu, Dan
    [J]. 2016 INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC 2016), 2016, : 9 - 14
  • [7] Multisensor Image Fusion based on Generative Adversarial Networks
    Lebedev, M. A.
    Komarov, D., V
    Vygolov, O. V.
    Vizilter, Yu. V.
    [J]. IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXV, 2019, 11155
  • [8] Multimodal Image Fusion Based on Generative Adversarial Networks
    Yang Xiaoli
    Lin Suzhen
    Lu Xiaofei
    Wang Lifang
    Li Dawei
    Wang Bin
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (16)
  • [9] Conditional Generative Adversarial Refinement Networks for Unbalanced Medical Image Semantic Segmentation
    Rezaei, Mina
    Yang, Haojin
    Harmuth, Konstantin
    Meinel, Christoph
    [J]. 2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1836 - 1845
  • [10] Multi-Model Medical Image Segmentation Using Multi-Stage Generative Adversarial Networks
    Khaled, Afifa
    Han, Jian-Jun
    Ghaleb, Taher A.
    [J]. IEEE ACCESS, 2022, 10 : 28590 - 28599