Multi-Source Fusion Image Semantic Segmentation Model of Generative Adversarial Networks Based on FCN

被引:2
|
作者
Zhao, Liang [1 ]
Wang, Ying [1 ]
Duan, Zhongxing [1 ]
Chen, Dengfeng [2 ]
Liu, Shipeng [1 ]
机构
[1] Xian Univ Architecture & Technol, Coll Informat & Control Engn, Xian 710055, Shaanxi, Peoples R China
[2] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Image segmentation; Convolution; Feature extraction; Semantics; Licenses; Image edge detection; Generative adversarial networks; Image semantic segmentation; fully convolutional networks; generative adversarial networks; efficient spatial pyramid; atrous spatial pyramid pooling;
D O I
10.1109/ACCESS.2021.3097054
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, most of the methods used in the research of image semantic segmentation ignore the low-level feature information of image, such as space, edge, etc., which leads to the problems that the segmentation of edge and small part is not precise enough and the accuracy of segmentation result is not high. To solve this problem, this paper proposes a multi-source fusion image semantic segmentation model of generative adversarial networks based on FCN: SCAGAN. In VGG19 network, add super-pixel and edge detection algorithm, and introduce the efficient spatial pyramid module to reduce the number of parameters while adding the spatial and edge information of image; Adjust the skipping structure to better integrate the low-level features and high-level features; build a generation model DeepLab-SCFCN combining with the atrous spatial pyramid pooling to better capture the feature information of different scales of the target for segmentation; The FCN with five modules is designed as the discrimination model for GAN. It is verified on the data set PASCAL VOC 2012 that the model achieves IoU of 70.1% with a small number of network layers, and the segmentation effect of edge and small part is better at the same time. This technology can be used in image semantic segmentation.
引用
收藏
页码:101985 / 101993
页数:9
相关论文
共 50 条
  • [41] Predicting circRNA-disease associations using deep generative adversarial network based on multi-source fusion information
    Wang, Lei
    You, Zhu-Hong
    Li, Li-Ping
    Zheng, Kai
    Wang, Yan-Bin
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 145 - 152
  • [42] Generative Adversarial Matrix Completion Network based on Multi-Source Data Fusion for miRNA-Disease Associations Prediction
    Wang, ShuDong
    Li, YunYin
    Zhang, YuanYuan
    Pang, ShanChen
    Qiao, SiBo
    Zhang, Yu
    Wang, FuYu
    [J]. BRIEFINGS IN BIOINFORMATICS, 2023, 24 (05)
  • [43] FISS GAN: A Generative Adversarial Network for Foggy Image Semantic Segmentation
    Kunhua Liu
    Zihao Ye
    Hongyan Guo
    Dongpu Cao
    Long Chen
    Fei-Yue Wang
    [J]. IEEE/CAA Journal of Automatica Sinica, 2021, 8 (08) : 1428 - 1439
  • [44] FISS GAN: A Generative Adversarial Network for Foggy Image Semantic Segmentation
    Liu, Kunhua
    Ye, Zihao
    Guo, Hongyan
    Cao, Dongpu
    Chen, Long
    Wang, Fei-Yue
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (08) : 1428 - 1439
  • [45] MULTI-SOURCE FUSION NETWORK FOR REMOTE SENSING IMAGE SEGMENTATION WITH HIERARCHICAL TRANSFORMER
    Liu, Bo
    Ren, Bo
    Hou, Biao
    Gu, Yu
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6318 - 6321
  • [46] Research on oil spill monitoring of multi-source remote sensing image based on deep semantic segmentation
    Chen Y.-T.
    Li Y.-Y.
    Lü S.-L.
    Wang J.-S.
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2020, 28 (05): : 1165 - 1176
  • [47] Traffic Flow Online Prediction Based on a Generative Adversarial Network with Multi-Source Data
    Sun, Tuo
    Sun, Bo
    Jiang, Zehao
    Hao, Ruochen
    Xie, Jiemin
    [J]. SUSTAINABILITY, 2021, 13 (21)
  • [48] Semantic Segmentation of Human Body using Generative Adversarial Neural Networks
    Pathak, Priyansha
    Narendra, Priyanka
    Mathanky, Raja S.
    Murthy, H. V. Srinivasa
    [J]. 2018 FOURTEENTH INTERNATIONAL CONFERENCE ON INFORMATION PROCESSING (ICINPRO) - 2018, 2018, : 221 - 222
  • [49] MMS:MULTI-SOURCE MUTUAL SUPERVISION SEMANTIC SEGMENTATION
    Guo, Shibo
    Gui, Yuanyuan
    Zhang, Mengmeng
    Li, Wei
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6928 - 6931
  • [50] The Spatially Seamless Spatiotemporal Fusion Model Based on Generative Adversarial Networks
    Weng, ChenYang
    Zhan, Yulin
    Gu, Xingfa
    Yang, Jian
    Liu, Yan
    Guo, Hong
    Lian, Zilong
    Zhang, Shiyuan
    Wang, Zhangjie
    Zhao, Xuechun
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 12760 - 12771