GCNet: Probing self-similarity learning for Generalized Counting Network

被引:0
|
作者
Wang, Mingjie [1 ]
Li, Yande [3 ]
Zhou, Jun [4 ]
Taylor, Graham W. [5 ]
Gong, Minglun [2 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Sci, Hangzhou, Peoples R China
[2] Univ Guelph, Sch Comp Sci, Guelph, ON, Canada
[3] Lanzhou Univ, Sch Informat Sci & Engn, Lanzhou, Peoples R China
[4] Dalian Maritime Univ, Informat Sci & Technol Coll, Dalian, Peoples R China
[5] Univ Guelph, Sch Engn, Guelph, ON, Canada
基金
中国国家自然科学基金; 加拿大自然科学与工程研究理事会;
关键词
Class-agnostic counting; Exemplar-free scheme; Zero-shot paradigm; Self-similarity learning;
D O I
10.1016/j.patcog.2024.110513
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The class -agnostic counting (CAC) problem has garnered significant attention recently due to its broad societal applications and formidable challenges. Existing approaches to counting objects of various categories typically rely on user -provided exemplars, which are challenging to obtain and limit their generality. In this paper, our goal is to empower the framework to recognize adaptive exemplars within entire images. To achieve this, we introduce a zero -shot Generalized Counting Network (GCNet), which utilizes a pseudo -Siamese structure to automatically and efficiently learn pseudo exemplar cues from inherent repetition patterns. In addition, a weakly -supervised scheme is presented to reduce the burden of laborious density maps required by all contemporary CAC models, allowing GCNet to be trained using count -level supervisory signals in an endto -end manner. Without providing any spatial location hints, GCNet is capable of adaptively capturing them through a carefully -designed self -similarity learning strategy. Extensive experiments and ablation studies on the prevailing benchmark FSC147 for zero -shot CAC demonstrate the superiority of our GCNet. It performs on par with existing exemplar -dependent methods and shows stunning cross-dataset generality on crowd -specific datasets, e.g. , ShanghaiTech Part A, Part B and UCF_QNRF.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Generalized self-similarity
    Cabrelli, CA
    Molter, UM
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1999, 230 (01) : 251 - 260
  • [2] Self-similarity of the desynchronization process in a network of generalized Kuramoto oscillators
    A. A. Koronovskii
    M. K. Kurovskaya
    O. I. Moskalenko
    A. E. Hramov
    [J]. Technical Physics Letters, 2017, 43 : 893 - 895
  • [3] Self-Similarity of the Desynchronization Process in a Network of Generalized Kuramoto Oscillators
    Koronovskii, A. A.
    Kurovskaya, M. K.
    Moskalenko, O. I.
    Hramov, A. E.
    [J]. TECHNICAL PHYSICS LETTERS, 2017, 43 (10) : 893 - 895
  • [4] Self-similarity of banking network
    Inaoka, H
    Takayasu, H
    Shimizu, T
    Ninomiya, T
    Taniguchi, K
    [J]. PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2004, 339 (3-4) : 621 - 634
  • [5] The wavelet detect of self-similarity in the network
    Guo, Zhi Yong
    Li, Jian Ping
    Liao, Ran Ming
    Gu, Xiao Feng
    Zhan, Si Yu
    [J]. WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING, VOL 1 AND 2, 2006, : 898 - +
  • [6] Probing asymmetry and self-similarity of fully developed turbulence
    Vainshtein, SI
    [J]. PHYSICAL REVIEW E, 1997, 56 (06): : 6787 - 6800
  • [7] Dictionary learning based on structural self-similarity and convolution neural network
    Zhang, Ling
    Jiang, Wenchao
    Xiang, Wen
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 13 (03) : 1463 - 1470
  • [8] Dictionary learning based on structural self-similarity and convolution neural network
    Ling Zhang
    Wenchao Jiang
    Wen Xiang
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2022, 13 : 1463 - 1470
  • [9] Learning Self-Similarity in Space and Time as Generalized Motion for Video Action Recognition
    Kwon, Heeseung
    Kim, Manjin
    Kwak, Suha
    Cho, Minsu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13045 - 13055
  • [10] Generalized self-similarity applied to matrix refinement equations
    Cabrelli, C
    Heil, C
    Molter, U
    [J]. ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1996, 76 : 493 - 494