Multi-Source Fusion Image Semantic Segmentation Model of Generative Adversarial Networks Based on FCN

被引:2
|
作者
Zhao, Liang [1 ]
Wang, Ying [1 ]
Duan, Zhongxing [1 ]
Chen, Dengfeng [2 ]
Liu, Shipeng [1 ]
机构
[1] Xian Univ Architecture & Technol, Coll Informat & Control Engn, Xian 710055, Shaanxi, Peoples R China
[2] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Shaanxi, Peoples R China
来源
IEEE ACCESS | 2021年 / 9卷
基金
中国国家自然科学基金;
关键词
Image segmentation; Convolution; Feature extraction; Semantics; Licenses; Image edge detection; Generative adversarial networks; Image semantic segmentation; fully convolutional networks; generative adversarial networks; efficient spatial pyramid; atrous spatial pyramid pooling;
D O I
10.1109/ACCESS.2021.3097054
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, most of the methods used in the research of image semantic segmentation ignore the low-level feature information of image, such as space, edge, etc., which leads to the problems that the segmentation of edge and small part is not precise enough and the accuracy of segmentation result is not high. To solve this problem, this paper proposes a multi-source fusion image semantic segmentation model of generative adversarial networks based on FCN: SCAGAN. In VGG19 network, add super-pixel and edge detection algorithm, and introduce the efficient spatial pyramid module to reduce the number of parameters while adding the spatial and edge information of image; Adjust the skipping structure to better integrate the low-level features and high-level features; build a generation model DeepLab-SCFCN combining with the atrous spatial pyramid pooling to better capture the feature information of different scales of the target for segmentation; The FCN with five modules is designed as the discrimination model for GAN. It is verified on the data set PASCAL VOC 2012 that the model achieves IoU of 70.1% with a small number of network layers, and the segmentation effect of edge and small part is better at the same time. This technology can be used in image semantic segmentation.
引用
收藏
页码:101985 / 101993
页数:9
相关论文
共 50 条
  • [21] GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks
    Zhiguang Yang
    Youping Chen
    Zhuliang Le
    Yong Ma
    [J]. Neural Computing and Applications, 2021, 33 : 6133 - 6145
  • [22] Multi-Semantic Fusion Generative Adversarial Network for Text-to-Image Generation
    Huang, Pingda
    Liu, Yedan
    Fu, Chunjiang
    Zhao, Liang
    [J]. 2023 IEEE 8TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS, ICBDA, 2023, : 159 - 164
  • [23] Semantic Segmentation of Remote Sensing Image Based on GAN and FCN Network Model
    Tian, Liang
    Zhong, Xiaorou
    Chen, Ming
    [J]. SCIENTIFIC PROGRAMMING, 2021, 2021
  • [24] Multi-source Domain Adaptation for Semantic Segmentation
    Zhao, Sicheng
    Li, Bo
    Yue, Xiangyu
    Gu, Yang
    Xu, Pengfei
    Hu, Runbo
    Chai, Hua
    Keutzer, Kurt
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [25] Towards Multi-source Adaptive Semantic Segmentation
    Russo, Paolo
    Tommasi, Tatiana
    Caputo, Barbara
    [J]. IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT I, 2019, 11751 : 292 - 301
  • [26] Generative adversarial networks in medical image segmentation: A review
    Xun, Siyi
    Li, Dengwang
    Zhu, Hui
    Chen, Min
    Wang, Jianbo
    Li, Jie
    Chen, Meirong
    Wu, Bing
    Zhang, Hua
    Chai, Xiangfei
    Jiang, Zekun
    Zhang, Yan
    Huang, Pu
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 140
  • [27] Generative Adversarial Networks for Road Crack Image Segmentation
    Gao, Ziping
    Peng, Bo
    Li, Tianrui
    Gou, Cong
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [28] Lung image segmentation via generative adversarial networks
    Cai, Jiaxin
    Zhu, Hongfeng
    Liu, Siyu
    Qi, Yang
    Chen, Rongshang
    [J]. FRONTIERS IN PHYSIOLOGY, 2024, 15
  • [29] Multi-Focus Image Fusion Based on Generative Adversarial Network
    Jiang, Liubing
    Zhang, Dian
    Pan, Bo
    Zheng, Peng
    Che, Li
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (11): : 1715 - 1725
  • [30] Semi-Supervised Semantic Image Segmentation by Deep Diffusion Models and Generative Adversarial Networks
    Diaz-Frances, Jose Angel
    Fernandez-Rodriguez, Jose David
    Thurnhofer-Hemsi, Karl
    Lopez-Rubio, Ezequiel
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2024, 34 (11)