Can Generative Adversarial Networks Teach Themselves Text Segmentation?

被引:0
|
作者
Al-Rawi, Mohammed [1 ]
Bazazian, Dena [1 ]
Valveny, Ernest [1 ]
机构
[1] Univ Autonoma Barcelona, Comp Vis Ctr, Barcelona, Spain
关键词
D O I
10.1109/ICCVW.2019.00416
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the information age in which we live, text segmentation from scene images is a vital prerequisite task used in many text understanding applications. Text segmentation is a difficult problem because of the potentially vast variation in text and scene landscape. Moreover, systems that learn to perform text segmentation usually need non-trivial annotation efforts. We present in this work a novel unsupervised method to segment text at the pixel-level from scene images. The model we propose, which relies on generative adversarial neural networks, segments text intelligently; and does not therefore need to associate the scene image that contains the text to the ground-truth of the text. The main advantage is thus skipping the need to obtain the pixel-level annotation dataset, which is normally required in training powerful text segmentation models. The results are promising, and to the best of our knowledge, constitute the first step towards reliable unsupervised text segmentation. Our work opens a new research path in unsupervised text segmentation and poses many research questions with a lot of trends available for further improvement.
引用
收藏
页码:3342 / 3350
页数:9
相关论文
共 50 条
  • [1] Text-to-Text Generative Adversarial Networks
    Li, Changliang
    Su, Yixin
    Liu, Wenju
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [2] Can Generative Adversarial Networks help to overcome the limited data problem in segmentation
    Heilemann, Gerd
    Matthewman, Mark
    Kuess, Peter
    Goldner, Gregor
    Widder, Joachim
    Georg, Dietmar
    Zimmermann, Lukas
    [J]. ZEITSCHRIFT FUR MEDIZINISCHE PHYSIK, 2022, 32 (03): : 361 - 368
  • [3] Lung image segmentation by generative adversarial networks
    Cai, Jiaxin
    Zhu, Hongfeng
    [J]. 2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [4] A Research on Generative Adversarial Networks Applied to Text Generation
    Zhang, Chao
    Xiong, Caiquan
    Wang, Lingyun
    [J]. 14TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND EDUCATION (ICCSE 2019), 2019, : 913 - 917
  • [5] A survey on text generation using generative adversarial networks
    de Rosa, Gustavo H.
    Papa, Joao P.
    [J]. PATTERN RECOGNITION, 2021, 119
  • [6] Text to Image Translation using Generative Adversarial Networks
    Viswanathan, Adithya
    Mehta, Bhavin
    Bhavatarini, M. P.
    Mamatha, H. R.
    [J]. 2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2018, : 1468 - 1474
  • [7] TEXT TO IMAGE SYNTHESIS WITH ERUDITE GENERATIVE ADVERSARIAL NETWORKS
    Zhang, Zhiqiang
    Yu, Wenxin
    Jiang, Ning
    Zhou, Jinjia
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2438 - 2442
  • [8] Generative adversarial networks in medical image segmentation: A review
    Xun, Siyi
    Li, Dengwang
    Zhu, Hui
    Chen, Min
    Wang, Jianbo
    Li, Jie
    Chen, Meirong
    Wu, Bing
    Zhang, Hua
    Chai, Xiangfei
    Jiang, Zekun
    Zhang, Yan
    Huang, Pu
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 140
  • [9] Generative adversarial networks based skin lesion segmentation
    Innani, Shubham
    Dutande, Prasad
    Baid, Ujjwal
    Pokuri, Venu
    Bakas, Spyridon
    Talbar, Sanjay
    Baheti, Bhakti
    Guntuku, Sharath Chandra
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [10] Improving Skin Lesion Segmentation with Generative Adversarial Networks
    Pollastri, Federico
    Bolelli, Federico
    Paredes, Roberto
    Grana, Costantino
    [J]. 2018 31ST IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS 2018), 2018, : 442 - 443