Efficient text-based query based on multi-level and deep-semantic multimedia indexing and retrieval

被引:0
|
作者
Hamroun, Mohamed [1 ,2 ]
Lajmi, Sonia [3 ,4 ]
Jallouli, Maryam [3 ]
Souid, Abdelbaki [5 ]
机构
[1] Univ Limoges, UMR CNRS 7252, XLIM, 123 Ave Albert Thomas, F-87060 Limoges, France
[2] 3iL Grp, 43 Rue St Anne, F-87015 Limoges, France
[3] Univ Sfax, MIRACL Lab, Technopole Sfax,POB 242, Sfax, Tunisia
[4] Albaha Univ, Albaha, Saudi Arabia
[5] Gabes Univ, Natl Engn Sch Gabes, MACS Res Lab RL16ES22, Gabes 6029, Tunisia
关键词
Textual query; Classification; Semantic indexing; Relevance feedback; Query expansion; Concept; Context; SENTIMENT ANALYSIS; FUSION; ATTENTION;
D O I
10.1007/s11042-023-17256-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent technological advancements have led to a significant increase in the quantity and accessibility of videos. The decrease in video acquisition costs and the increase in memory capacity have made it possible to store large video collections in computer systems. To effectively exploit these collections, it is crucial to have tools that facilitate access and management. In this paper, we present a multimedia retrieval approach that prioritizes the user's needs by starting with a text-based query. The approach consists of two main parts: (i) a new multi-level and deep-semantic video classification indexing method, and (ii) a query expansion mechanism and relevance feedback system to improve the results based on the user's feedback. Our contribution is demonstrated through the implementation of the Deep-VISEN prototype and experiments on a collection of 2700 videos and 62838 images. The results show that our algorithm is effective and precise.
引用
收藏
页码:55811 / 55850
页数:40
相关论文
共 50 条
  • [41] Efficient Content-based Multimedia Retrieval Using Novel Indexing Structure in PostgreSQL
    Fleites, Fausto C.
    Chen, Shu-Ching
    2013 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2013, : 500 - 501
  • [42] Narrowing the semantic gap - Improved text-based web document retrieval using visual features
    Zhao, R
    Grosky, WI
    IEEE TRANSACTIONS ON MULTIMEDIA, 2002, 4 (02) : 189 - 200
  • [43] RESEARCH ON EFFICIENT INDEXING OF LARGE-SCALE GEOSPATIAL DATA BASED ON MULTI-LEVEL GEOGRAPHIC GRID
    Gao, Yin
    Duo, Hairui
    Che, Jian
    Zhao, Shiquan
    Zhao, Bianli
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 73 - 80
  • [44] DSSL: Deep Surroundings-person Separation Learning for Text-based Person Retrieval
    Zhu, Aichun
    Wang, Zijie
    Li, Yifeng
    Wan, Xili
    Jin, Jing
    Wang, Tian
    Hu, Fangqiang
    Hua, Gang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 209 - 217
  • [45] An Efficient Multi Query System for Content Based Image Retrieval Using Query Replacement
    Vimina, E. R.
    Ramakrishnan, K.
    Nandakumar, Navya
    Jacob, Poulose K.
    2015 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2015, : 43 - 47
  • [46] DCEL: Deep Cross-modal Evidential Learning for Text-Based Person Retrieval
    Li, Shenshen
    Xu, Xing
    Yang, Yang
    Shen, Fumin
    Mo, Yijun
    Li, Yujie
    Shen, Heng Tao
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6292 - 6300
  • [47] Efficient Feature Recombining Network Based on Refining Multi-Level Feature Maps for Semantic Segmentation
    Zhao, Luan
    Zhang, Xiaofeng
    IEEE ACCESS, 2020, 8 : 228409 - 228419
  • [48] Multi-level video captioning method based on semantic space
    Yao, Xiao
    Zeng, Yuanlin
    Gu, Min
    Yuan, Ruxi
    Li, Jie
    Ge, Junyi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (28) : 72113 - 72130
  • [49] An image understanding method based on multi-level semantic features
    Mo H.-W.
    Tian P.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (12): : 2881 - 2890
  • [50] Bridging the gap: multi-granularity representation learning for text-based vehicle retrieval
    Xue Bo
    Junjie Liu
    Di Yang
    Wentao Ma
    Complex & Intelligent Systems, 2025, 11 (1)