Robust fine-grained visual recognition with images based on internet of things

被引:0
|
作者
Cai, Zhenhuang [1 ]
Yan, Shuai [1 ]
Huang, Dan [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
关键词
deep neural network; domain mismatch; fine-grained recognition; internet of things; label noise; NETWORK;
D O I
10.1111/coin.12638
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Labeling fine-grained objects manually is extremely challenging, as it is not only label-intensive but also requires professional knowledge. Accordingly, robust learning methods for fine-grained recognition with web images collected from Internet of Things have drawn significant attention. However, training deep fine-grained models directly using untrusted web images is confronted by two primary obstacles: (1) label noise in web images and (2) domain variance between the online sources and test datasets. To this end, in this study, we mainly focus on addressing these two pivotal problems associated with untrusted web images. To be specific, we introduce an end-to-end network that collaboratively addresses these concerns in the process of separating trusted data from untrusted web images. To validate the efficacy of our proposed model, untrusted web images are first collected by utilizing the text category labels found within fine-grained datasets. Subsequently, we employ the designed deep model to eliminate label noise and ameliorate domain mismatch. And the chosen trusted web data are utilized for model training. Comprehensive experiments and ablation studies validate that our method consistently surpasses other state-of-the-art approaches for fine-grained recognition tasks in real-world scenarios, demonstrating a significant improvement margin (2.51% on CUB200-2011 and 2.92% on Stanford Dogs). The source code and models can be accessed at: .
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Global Information-Assisted Fine-Grained Visual Categorization in Internet of Things
    Li, Ang
    Kang, Bin
    Chen, Jianxin
    Wu, Dan
    Zhou, Liang
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (01) : 940 - 952
  • [2] Fine-grained recognition of plants from images
    Milan Šulc
    Jiří Matas
    Plant Methods, 13
  • [3] Fine-grained recognition of plants from images
    Sulc, Milan
    Matas, Jiri
    PLANT METHODS, 2017, 13
  • [4] Robust Fine-Grained Visual Recognition With Neighbor-Attention Label Correction
    Mao, Shunan
    Zhang, Shiliang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 2614 - 2626
  • [5] Fine-Grained Crowdsourcing for Fine-Grained Recognition
    Jia Deng
    Krause, Jonathan
    Li Fei-Fei
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 580 - 587
  • [6] Annotation modification for fine-grained visual recognition
    Luo, Changzhi
    Meng, Zhijun
    Feng, Jiashi
    Ni, Bingbing
    Wang, Meng
    NEUROCOMPUTING, 2018, 274 : 58 - 65
  • [7] Multi-proxy feature learning for robust fine-grained visual recognition
    Mao, Shunan
    Wang, Yaowei
    Wang, Xiaoyu
    Zhang, Shiliang
    PATTERN RECOGNITION, 2023, 143
  • [8] Fine-Grained Encryption for Search and Rescue Operation on Internet of Things
    Li, Depeng
    Sampalli, Srinivas
    Aung, Zeyar
    Williams, John
    Sanchez, Abel
    2014 ASIA-PACIFIC WORLD CONGRESS ON COMPUTER SCIENCE AND ENGINEERING (APWC ON CSE), 2014,
  • [9] Semantic Clustering for Robust Fine-Grained Scene Recognition
    George, Marian
    Dixit, Mandar
    Zogg, Gabor
    Vasconcelos, Nuno
    COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 : 783 - 798
  • [10] Depth Fine-Grained Recognition Method for Rock Images
    Miao, Yiyuan
    Gao, Shang
    Gu, Jie
    Shao, Changbin
    2024 9TH INTERNATIONAL CONFERENCE ON ELECTRONIC TECHNOLOGY AND INFORMATION SCIENCE, ICETIS 2024, 2024, : 536 - 542