Cross-domain pedestrian detection via feature alignment and image quality assessment

被引:0
|
作者
Yao, Jun [1 ]
Guo, Zhilin [1 ]
Yu, Junjie [1 ]
Yan, Nan [1 ]
Wang, Qiong [1 ]
Yu, Wei [1 ,2 ]
机构
[1] Chengdu Univ Technol, Engn & Tech Coll, Xiaoba Rd, Leshan 614000, Peoples R China
[2] China Univ Min & Technol, Daxue Rd, Xuzhou 221116, Peoples R China
关键词
NETWORK;
D O I
10.1016/j.isci.2024.109639
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Datasets collected under different sensors, viewpoints, or weather conditions cause different domains. Models trained on domain A applied to tasks of domain B result in low performance. To overcome the domain shift, we propose an unsupervised pedestrian detection method that utilizes CycleGAN to establish an intermediate domain and transform a large gap domain -shift problem into two feature alignment subtasks with small gaps. The intermediate domain trained with labels from domain A, after two rounds of feature alignment using adversarial learning, can facilitate effective detection in domain B. To further enhance the training quality of intermediate domain models, Image Quality Assessment (IQA) is incorporated. The experimental results evaluated on Citypersons, KITTI, and BDD100K show that MR of 24.58%, 33.66%, 28.27%, and 28.25% were achieved in four cross -domain scenarios. Compared with typical pedestrian detection models, our proposed method can better overcome the domain -shift problem and achieve competitive results.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] SAN: Selective Alignment Network for Cross-Domain Pedestrian Detection
    Jiao, Yifan
    Yao, Hantao
    Xu, Changsheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2155 - 2167
  • [2] Cross-Domain Feature Similarity Guided Blind Image Quality Assessment
    Feng, Chenxi
    Ye, Long
    Zhang, Qin
    [J]. FRONTIERS IN NEUROSCIENCE, 2022, 15
  • [3] AFAN: Augmented Feature Alignment Network for Cross-Domain Object Detection
    Wang, Hongsong
    Liao, Shengcai
    Shao, Ling
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4046 - 4056
  • [4] DIVERGENCE-GUIDED FEATURE ALIGNMENT FOR CROSS-DOMAIN OBJECT DETECTION
    Li, Zongyao
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2240 - 2244
  • [5] Unsupervised Cross-domain Image Classification by Distance Metric Guided Feature Alignment
    Meng, Qingjie
    Rueckert, Daniel
    Kainz, Bernhard
    [J]. MEDICAL ULTRASOUND, AND PRETERM, PERINATAL AND PAEDIATRIC IMAGE ANALYSIS, ASMUS 2020, PIPPI 2020, 2020, 12437 : 146 - 157
  • [6] Enhanced Cross-Domain Dim and Small Infrared Target Detection via Content-Decoupled Feature Alignment
    Zhang, Yu
    Zhang, Yan
    Shi, Zhiguang
    Fu, Ruigang
    Liu, Di
    Zhang, Yi
    Du, Jinming
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Decompose to Adapt: Cross-Domain Object Detection Via Feature Disentanglement
    Liu, Dongnan
    Zhang, Chaoyi
    Song, Yang
    Huang, Heng
    Wang, Chenyu
    Barnett, Michael
    Cai, Weidong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1333 - 1344
  • [8] Cross-domain object detection by local to global object-aware feature alignment
    Song, Yiguo
    Liu, Zhenyu
    Tang, Ruining
    Duan, Guifang
    Tan, Jianrong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2024, 36 (07): : 3631 - 3644
  • [9] Cross-domain object detection by local to global object-aware feature alignment
    Yiguo Song
    Zhenyu Liu
    Ruining Tang
    Guifang Duan
    Jianrong Tan
    [J]. Neural Computing and Applications, 2024, 36 : 3631 - 3644
  • [10] Joint alignment of the distribution in input and feature space for cross-domain aerial image semantic segmentation
    Chen, Zhe
    Yang, Bisheng
    Ma, Ailong
    Peng, Mingjun
    Li, Haiting
    Chen, Tao
    Chen, Chi
    Dong, Zhen
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 115