Discriminative Feature Learning With Co-Occurrence Attention Network for Vehicle ReID

被引:19
|
作者
Sheng, Hao [1 ,2 ,3 ]
Wang, Shuai [2 ,4 ]
Chen, Haobo [5 ]
Yang, Da [2 ,4 ]
Huang, Yang [5 ]
Shen, Jiahao
Ke, Wei [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Hangzhou 311115, Peoples R China
[3] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
[4] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[5] ByteDance, Beijing 100089, Peoples R China
关键词
Feature extraction; Task analysis; Videos; Representation learning; Pipelines; Image color analysis; Visualization; Vehicle re-identification; co-occurrence attention; discriminative learning; image representation;
D O I
10.1109/TCSVT.2023.3326375
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle Re-Identification (ReID) aims to find images of the same vehicle from different videos. It remains a challenging task in the video analysis field due to the huge appearance discrepancy of the same vehicle in cross-view matching and the subtle difference of different similar vehicles in same-view matching. In this paper, we propose a Co-occurrence Attention Net (CAN) to deal with these two challenges. Specifically, CAN consists of two branches, a main branch and an aware branch. The main branch is in charge of extracting global features that are consistent in most views. This feature encodes holistic information such as color and pose, however, it can not handle cross/same-view hard cases, as shown in Fig.1. Therefore, the aware branch is designed to focus on the local details and viewpoint information, which can become an important complement for those hard cases. Considering that the positions of local areas such as wheels and logos change with the viewpoint, Aware Attention Module is introduced to find the hidden relationship among local areas and seamlessly combine the viewpoint information simultaneously. Then, CAN is trained by a partition-and-reunion-based loss, which can narrow the intra-class distance and increase the inter-class distance. Further, an adaptive co-occurrence view emphasize strategy is adopted to fully utilize the learned features. Experimental results on three widely used datasets including VeRi-776, VehicleID and VERI-Wild demonstrate the effectiveness of our method and competitive performance with other state-of-the-art methods.
引用
收藏
页码:3510 / 3522
页数:13
相关论文
共 50 条
  • [41] Video Copy Detection using Motion Co-occurrence Feature
    Arabaci, Mehmet Ali
    Esen, Ersin
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 1946 - 1949
  • [42] Co-occurrence trees: A dynamic solution for texture feature extraction
    Svolos, AE
    Hutton, CA
    Pokropek, AT
    PROCEEDINGS OF THE 18TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOL 18, PTS 1-5, 1997, 18 : 1142 - 1144
  • [43] Consonant co-occurrence classes and the feature-economy principle
    Nikolaev, Dmitry
    Grossman, Eitan
    PHONOLOGY, 2020, 37 (03) : 419 - 451
  • [44] Template matching with multi-feature co-occurrence matrix
    Jiang S.-P.
    Xiang W.
    Liu Y.-P.
    Luo H.-B.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (06): : 1459 - 1467
  • [45] A Novel Fuzzy Co-occurrence Matrix for Texture Feature Extraction
    Munklang, Yutthana
    Auephanwiriyakul, Sansanee
    Theera-Umpon, Nipon
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS (ICCSA 2013), PT III, 2013, 7973 : 246 - 257
  • [46] Dimensionality reduction by feature Co-occurrence based rough set
    La L.
    Cao Q.
    Xu N.
    International Journal of Performability Engineering, 2019, 15 (01) : 307 - 316
  • [47] Emergent Properties from Feature Co-occurrence in Image Collections
    Khan, Umair Mateen
    Mills, Steven
    McCane, Brendan
    Trotman, Andrew
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2347 - 2352
  • [48] LEARNING CO-OCCURRENCE RESTRICTIONS - RULE INDUCTION OR ROTE LEARNING
    SMITH, KH
    JOURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR, 1969, 8 (02): : 319 - &
  • [49] A Hybrid Recommendation System Based on Correlation and Co-Occurrence Within Social Learning Network
    Souabi, Sonia
    Retbi, Asmaa
    Idrissi, Mohammed Khalidi
    Bennani, Samir
    ADVANCED INTELLIGENT SYSTEMS FOR SUSTAINABLE DEVELOPMENT (AI2SD'2020), VOL 1, 2022, 1417 : 135 - 145
  • [50] Functional brain network alterations in the co-occurrence of autism spectrum disorder and attention deficit hyperactivity disorder
    Lin, Qiwen
    Shi, Yafei
    Huang, Huiyuan
    Jiao, Bingqing
    Kuang, Changyi
    Chen, Jiawen
    Rao, Yuyang
    Zhu, Yunpeng
    Liu, Wenting
    Huang, Ruiwang
    Lin, Jiabao
    Ma, Lijun
    EUROPEAN CHILD & ADOLESCENT PSYCHIATRY, 2024, 33 (02) : 369 - 380