Attention-Guided Collaborative Counting

被引:10
|
作者
Mo, Hong [1 ]
Ren, Wenqi [2 ]
Zhang, Xiong [3 ]
Yan, Feihu [4 ]
Zhou, Zhong [1 ]
Cao, Xiaochun [2 ]
Wu, Wei [1 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Sun Yat Sen Univ, Sch Cyber Sci & Technol, Shenzhen Campus, Shenzhen 518107, Peoples R China
[3] Neolix Autonomous Vehicle, Beijing 100016, Peoples R China
[4] Beijing Univ Civil Engn & Architecture, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Collaboration; Transformers; Task analysis; Head; Computational modeling; Computer vision; Crowd counting; attention-guided collaborative counting model; bi-directional transformer;
D O I
10.1109/TIP.2022.3207584
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing crowd counting designs usually exploit multi-branch structures to address the scale diversity problem. However, branches in these structures work in a competitive rather than collaborative way. In this paper, we focus on promoting collaboration between branches. Specifically, we propose an attention-guided collaborative counting module (AGCCM) comprising an attention-guided module (AGM) and a collaborative counting module (CCM). The CCM promotes collaboration among branches by recombining each branch's output into an independent count and joint counts with other branches. The AGM capturing the global attention map through a transformer structure with a pair of foreground-background related loss functions can distinguish the advantages of different branches. The loss functions do not require additional labels and crowd division. In addition, we design two kinds of bidirectional transformers (Bi-Transformers) to decouple the global attention to row attention and column attention. The proposed Bi-Transformers are able to reduce the computational complexity and handle images in any resolution without cropping the image into small patches. Extensive experiments on several public datasets demonstrate that the proposed algorithm performs favorably against the state-of-the-art crowd counting methods.
引用
收藏
页码:6306 / 6319
页数:14
相关论文
共 50 条
  • [41] Attention-Guided Memory Model for Video Object Segmentation
    Lin, Yunjian
    Tan, Yihua
    Communications in Computer and Information Science, 2022, 1566 CCIS : 67 - 85
  • [42] Attention-Guided Image Captioning through Word Information
    Tang, Ziwei
    Yi, Yaohua
    Sheng, Hao
    SENSORS, 2021, 21 (23)
  • [43] Attention-Guided Model for Robust Face Detection System
    Kurnianggoro, Laksono
    Jo, Kang-Hyun
    IMAGE AND VIDEO TECHNOLOGY (PSIVT 2019), 2019, 11854 : 41 - 51
  • [44] Attention-guided Adversarial Attack for Video Object Segmentation
    Yao, Rui
    Chen, Ying
    Zhou, Yong
    Hu, Fuyuan
    Zhao, Jiaqi
    Liu, Bing
    Shao, Zhiwen
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (06)
  • [45] Attention-Guided Multitask Learning for Surface Defect Identification
    Sampath, Vignesh
    Maurtua, Inaki
    Martin, Juan Jose Aguilar
    Rivera, Andoni
    Molina, Jorge
    Gutierrez, Aitor
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (09) : 9713 - 9721
  • [46] Attention-guided Temporally Coherent Video Object Matting
    Zhang, Yunke
    Wang, Chi
    Cui, Miaomiao
    Ren, Peiran
    Xie, Xuansong
    Hua, Xian-Sheng
    Bao, Hujun
    Huang, Qixing
    Xu, Weiwei
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5128 - 5137
  • [47] DAHP: Deep Attention-Guided Hashing With Pairwise Labels
    Li, Xue
    Yu, Jiong
    Wang, Yongqiang
    Chen, Jia-Ying
    Chang, Peng-Xiao
    Li, Ziyang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 933 - 946
  • [48] Attention-Guided Digital Adversarial Patches on Visual Detection
    Lang, Dapeng
    Chen, Deyun
    Shi, Ran
    He, Yongjun
    SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
  • [49] Crowd Counting Guided by Attention Network
    Nie, Pei
    Fan, Cien
    Zou, Lian
    Chen, Liqiong
    Li, Xiaopeng
    INFORMATION, 2020, 11 (12) : 1 - 10
  • [50] Attention-Guided HDR Reconstruction for Enhancing Smart City Applications
    Chen, Yung-Yao
    Hsia, Chih-Hsien
    Jhong, Sin-Ye
    Lai, Chin-Feng
    ELECTRONICS, 2023, 12 (22)