Towards Fast and Accurate Image-Text Retrieval with Self-Supervised Fine-Grained Alignment

被引:0
|
作者
Zhuang, Jiamin [1 ,2 ]
Yu, Jing [1 ,2 ]
Ding, Yang [1 ,2 ]
Qu, Xiangyan [1 ,2 ]
Hu, Yue [1 ,2 ]
机构
[1] Institute of Information Engineering, Chinese Academy of Sciences, China
[2] The School of Cyber Security, University of Chinese Academy of Sciences, China
来源
arXiv | 2023年
关键词
Engineering Village;
D O I
暂无
中图分类号
学科分类号
摘要
Concept levels - Concept-level cross-modal alignment - Context-level cross-modal alignment - Cross-modal - Embeddings - Fast image-text retrieval - Image texts - Self-supervised learning - Text retrieval
引用
收藏
相关论文
共 50 条
  • [1] Towards Fast and Accurate Image-Text Retrieval With Self-Supervised Fine-Grained Alignment
    Zhuang, Jiamin
    Yu, Jing
    Ding, Yang
    Qu, Xiangyan
    Hu, Yue
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1361 - 1372
  • [2] ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval
    Messina, Nicola
    Stefanini, Matteo
    Cornia, Marcella
    Baraldi, Lorenzo
    Falchi, Fabrizio
    Amato, Giuseppe
    Cucchiara, Rita
    [J]. 19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 64 - 70
  • [3] Memorize, Associate and Match: Embedding Enhancement via Fine-Grained Alignment for Image-Text Retrieval
    Li, Jiangtong
    Liu, Liu
    Niu, Li
    Zhang, Liqing
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 9193 - 9207
  • [4] Fine-Grained Object Classification via Self-Supervised Pose Alignment
    Yang, Xuhui
    Wang, Yaowei
    Chen, Ke
    Xu, Yong
    Tian, Yonghong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7389 - 7398
  • [5] Fine-Grained Image-Text Retrieval via Discriminative Latent Space Learning
    Zheng, Min
    Wang, Wen
    Li, Qingyong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 (28) : 643 - 647
  • [6] Fine-Grained Self-Supervised Learning with Jigsaw puzzles for medical image classification
    Park W.
    Ryu J.
    [J]. Comput. Biol. Med., 2024,
  • [7] Mining Fine-Grained Image-Text Alignment for Zero-Shot Captioning via Text-Only Training
    Qiu, Longtian
    Ning, Shan
    He, Xuming
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4605 - 4613
  • [8] Fine-Grained Information Supplementation and Value-Guided Learning for Remote Sensing Image-Text Retrieval
    Zhou, Zihui
    Feng, Yong
    Qiu, Agen
    Duan, Guofan
    Zhou, Mingliang
    [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17 : 19194 - 19210
  • [9] TECMH: Transformer-Based Cross-Modal Hashing For Fine-Grained Image-Text Retrieval
    Li, Qiqi
    Ma, Longfei
    Jiang, Zheng
    Li, Mingyong
    Jin, Bo
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 3713 - 3728
  • [10] Collaborative fine-grained interaction learning for image-text sentiment analysis
    Xiao, Xingwang
    Pu, Yuanyuan
    Zhou, Dongming
    Cao, Jinde
    Gu, Jinjing
    Zhao, Zhengpeng
    Xu, Dan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 279