Progressive scene text erasing with self-supervision

被引:1
|
作者
Du, Xiangcheng [1 ]
Zhou, Zhao [1 ]
Zheng, Yingbin [2 ]
Wu, Xingjiao [1 ]
Ma, Tianlong [1 ]
Jin, Cheng [1 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Videt Lab, Shanghai, Peoples R China
关键词
Scene text erasing; Progressive strategy; Self-supervision;
D O I
10.1016/j.cviu.2023.103712
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Scene text erasing seeks to erase text contents from scene images and current state-of-the-art text erasing models are trained on large-scale synthetic data. Although data synthetic engines can provide vast amounts of annotated training samples, there are differences between synthetic and real-world data. In this paper, we employ self-supervision for feature representation on unlabeled real-world scene text images. A novel pretext task is designed to keep consistent among text stroke masks of image variants. We design the Progressive Erasing Network in order to remove residual texts. The scene text is erased progressively by leveraging the intermediate generated results which provide the foundation for subsequent higher quality results. Experiments show that our method significantly improves the generalization of the text erasing task and achieves state-of-the-art performance on public benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Erasing Scene Text with Weak Supervision
    Zdenek, Jan
    Nakayama, Hideki
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2227 - 2235
  • [2] Enhanced Text-to-Image Synthesis With Self-Supervision
    Tan, Yong Xuan
    Lee, Chin Poo
    Neo, Mai
    Lim, Kian Ming
    Lim, Jit Yan
    IEEE ACCESS, 2023, 11 : 39508 - 39519
  • [3] Explainable Action Prediction through Self-Supervision on Scene Graphs
    Kochakarn, Pawit
    Martini, Daniele De
    Omeiza, Daniel
    Kunze, Lars
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1479 - 1485
  • [4] DATE: Detecting Anomalies in Text via Self-Supervision of Transformers
    Manolache, Andrei
    Brad, Florin
    Burceanu, Elena
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 267 - 277
  • [5] THE FEASIBILITY OF SELF-SUPERVISION
    Hudelson, Earl
    JOURNAL OF EDUCATIONAL RESEARCH, 1952, 45 (05): : 335 - 347
  • [6] Progressive Multi-View Human Mesh Recovery with Self-Supervision
    Gong, Xuan
    Song, Liangchen
    Zheng, Meng
    Planche, Benjamin
    Chen, Terrence
    Yuan, Junsong
    Doermann, David
    Wu, Ziyan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 676 - 684
  • [7] Self-supervision, surveillance and transgression
    Simon, Gail
    JOURNAL OF FAMILY THERAPY, 2010, 32 (03) : 308 - 325
  • [8] Anomalies, representations, and self-supervision
    Dillon, Barry M.
    Favaro, Luigi
    Feiden, Friedrich
    Modak, Tanmoy
    Plehn, Tilman
    SCIPOST PHYSICS CORE, 2024, 7 (03):
  • [9] Symmetries, safety, and self-supervision
    Dillon, Barry M.
    Kasieczka, Gregor
    Olischlaeger, Hans
    Plehn, Tilman
    Sorrenson, Peter
    Vogel, Lorenz
    SCIPOST PHYSICS, 2022, 12 (06):
  • [10] Self-Supervision: Psychodynamic Strategies
    Brenner, Ira
    JOURNAL OF THE AMERICAN PSYCHOANALYTIC ASSOCIATION, 2024, 72 (02)