Irregular Scene Text Detection Based on a Graph Convolutional Network

被引:2
|
作者
Zhang, Shiyu [1 ,2 ]
Zhou, Caiying [1 ]
Li, Yonggang [2 ]
Zhang, Xianchao [3 ]
Ye, Lihua [2 ]
Wei, Yuanwang [2 ,3 ]
机构
[1] Jiangxi Univ Sci & Technol, Coll Sci, Ganzhou 341000, Peoples R China
[2] Jiaxing Univ, Coll Informat Sci & Engn, Jiaxing 314001, Peoples R China
[3] Jiaxing Univ, Key Lab Med Elect & Digital Hlth Zhejiang Prov, Jiaxing 314001, Peoples R China
关键词
text detection; scene image; irregular; relation inference; GCN;
D O I
10.3390/s23031070
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detecting irregular or arbitrary shape text in natural scene images is a challenging task that has recently attracted considerable attention from research communities. However, limited by the CNN receptive field, these methods cannot directly capture relations between distant component regions by local convolutional operators. In this paper, we propose a novel method that can effectively and robustly detect irregular text in natural scene images. First, we employ a fully convolutional network architecture based on VGG16_BN to generate text components via the estimated character center points, which can ensure a high text component detection recall rate and fewer noncharacter text components. Second, text line grouping is treated as a problem of inferring the adjacency relations of text components with a graph convolution network (GCN). Finally, to evaluate our algorithm, we compare it with other existing algorithms by performing experiments on three public datasets: ICDAR2013, CTW-1500 and MSRA-TD500. The results show that the proposed method handles irregular scene text well and that it achieves promising results on these three public datasets.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] A Novel Scene Text Detection Algorithm Based On Convolutional Neural Network
    Ren, Xiaohang
    Chen, Kai
    Yang, Xiaokang
    Zhou, Yi
    He, Jianhua
    Sun, Jun
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [2] RECURRENT GLOBAL CONVOLUTIONAL NETWORK FOR SCENE TEXT DETECTION
    Mohanty, Sabyasachi
    Dutta, Tanima
    Gupta, Hari Prabhat
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2750 - 2754
  • [3] Text-Attentional Convolutional Neural Network for Scene Text Detection
    He, Tong
    Huang, Weilin
    Qiao, Yu
    Yao, Jian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (06) : 2529 - 2541
  • [4] A Graph-Transformer Network for Scene Text Detection
    Wu, Yongrong
    Lin, Jingyu
    Chen, Houjin
    Chen, Dinghao
    Yang, Lvqing
    Xiahou, Jianbing
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 680 - 690
  • [5] Multi-Scale Scene Text Detection Based on Convolutional Neural Network
    Lu, Yan-Feng
    Zhang, Ai-Xuan
    Li, Yi
    Yu, Qian-Hui
    Qiao, Hong
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 583 - 587
  • [6] Natural Scene Text Detection Based on Deep Supervised Fully Convolutional Network
    Zhang, Nan
    Jin, Xiaoning
    Li, Xiaowei
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT III, 2018, 11166 : 439 - 448
  • [7] Scene Text Detection Based On Fusion Network
    Zhao, Xuezhuan
    Zhou, Ziheng
    Li, Lingling
    Pei, Lishen
    Ye, Zhaoyi
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (10)
  • [8] Rumor detection using dual embeddings and text-based graph convolutional network
    Pattanaik, Barsha
    Mandal, Sourav
    Tripathy, Rudra M.
    Sekh, Arif Ahmed
    Discover Artificial Intelligence, 2024, 4 (01):
  • [9] Scene text detection via extremal region based double threshold convolutional network classification
    Zhu, Wei
    Lou, Jing
    Chen, Longtao
    Xia, Qingyuan
    Ren, Mingwu
    PLOS ONE, 2017, 12 (08):
  • [10] An Integration Model Based on Graph Convolutional Network for Text Classification
    Tang, Hengliang
    Mi, Yuan
    Xue, Fei
    Cao, Yang
    IEEE ACCESS, 2020, 8 : 148865 - 148876