Discriminative Feature Learning With Co-Occurrence Attention Network for Vehicle ReID

被引:19
|
作者
Sheng, Hao [1 ,2 ,3 ]
Wang, Shuai [2 ,4 ]
Chen, Haobo [5 ]
Yang, Da [2 ,4 ]
Huang, Yang [5 ]
Shen, Jiahao
Ke, Wei [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Hangzhou 311115, Peoples R China
[3] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
[4] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[5] ByteDance, Beijing 100089, Peoples R China
关键词
Feature extraction; Task analysis; Videos; Representation learning; Pipelines; Image color analysis; Visualization; Vehicle re-identification; co-occurrence attention; discriminative learning; image representation;
D O I
10.1109/TCSVT.2023.3326375
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle Re-Identification (ReID) aims to find images of the same vehicle from different videos. It remains a challenging task in the video analysis field due to the huge appearance discrepancy of the same vehicle in cross-view matching and the subtle difference of different similar vehicles in same-view matching. In this paper, we propose a Co-occurrence Attention Net (CAN) to deal with these two challenges. Specifically, CAN consists of two branches, a main branch and an aware branch. The main branch is in charge of extracting global features that are consistent in most views. This feature encodes holistic information such as color and pose, however, it can not handle cross/same-view hard cases, as shown in Fig.1. Therefore, the aware branch is designed to focus on the local details and viewpoint information, which can become an important complement for those hard cases. Considering that the positions of local areas such as wheels and logos change with the viewpoint, Aware Attention Module is introduced to find the hidden relationship among local areas and seamlessly combine the viewpoint information simultaneously. Then, CAN is trained by a partition-and-reunion-based loss, which can narrow the intra-class distance and increase the inter-class distance. Further, an adaptive co-occurrence view emphasize strategy is adopted to fully utilize the learned features. Experimental results on three widely used datasets including VeRi-776, VehicleID and VERI-Wild demonstrate the effectiveness of our method and competitive performance with other state-of-the-art methods.
引用
收藏
页码:3510 / 3522
页数:13
相关论文
共 50 条
  • [31] A recommendation approach based on correlation and co-occurrence within social learning network
    Souabi, Sonia
    Retbi, Asmaa
    Idrissi, Mohammed Khalidi
    Bennani, Samir
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (14):
  • [32] A Recommendation approach based on Correlation and Co-occurrence within social learning network
    Souabi, Sonia
    Retbi, Asmaa
    Idrissi, Mohammed Khalidi
    Bennani, Samir
    PROCEEDINGS OF 2020 5TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS (CLOUDTECH'20), 2020, : 10 - 15
  • [33] Social network of co-occurrence in news articles
    Özgür, A
    Bingol, H
    COMPUTER AND INFORMATION SCIENCES - ISCIS 2004, PROCEEDINGS, 2004, 3280 : 688 - 695
  • [34] Proposal of chance index in co-occurrence network
    Takayama, Yukihiro
    Saga, Ryosuke
    IEEJ Transactions on Electronics, Information and Systems, 2015, 135 (06) : 644 - 650
  • [35] Proposal of Chance Index in Co-occurrence Network
    Takayama, Yukihiro
    Saga, Ryosuke
    ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2016, 99 (12) : 65 - 73
  • [36] The structure of word co-occurrence network for microblogs
    Garg, Muskan
    Kumar, Mukesh
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 512 : 698 - 720
  • [37] A Deep Embedding Model for Co-occurrence Learning
    Shen, Yelong
    Jin, Ruoming
    Chen, Jianshu
    He, Xiaodong
    Gao, Jianfeng
    Deng, Li
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 631 - 638
  • [38] The Study of Trends in AI Applications for Vehicle Maintenance Through Keyword Co-occurrence Network Analysis
    Li, Wei
    Li, Guoyan
    Kamarthi, Sagar
    INTERNATIONAL JOURNAL OF PROGNOSTICS AND HEALTH MANAGEMENT, 2023, 14 (02)
  • [39] Image downscaling via co-occurrence learning
    Ghosh, Sanjay
    Garai, Arpan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 91
  • [40] Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregation
    Li, Chao
    Zhong, Qiaoyong
    Xie, Di
    Pu, Shiliang
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 786 - 792