Efficient text-based query based on multi-level and deep-semantic multimedia indexing and retrieval

被引:0
|
作者
Hamroun, Mohamed [1 ,2 ]
Lajmi, Sonia [3 ,4 ]
Jallouli, Maryam [3 ]
Souid, Abdelbaki [5 ]
机构
[1] Univ Limoges, UMR CNRS 7252, XLIM, 123 Ave Albert Thomas, F-87060 Limoges, France
[2] 3iL Grp, 43 Rue St Anne, F-87015 Limoges, France
[3] Univ Sfax, MIRACL Lab, Technopole Sfax,POB 242, Sfax, Tunisia
[4] Albaha Univ, Albaha, Saudi Arabia
[5] Gabes Univ, Natl Engn Sch Gabes, MACS Res Lab RL16ES22, Gabes 6029, Tunisia
关键词
Textual query; Classification; Semantic indexing; Relevance feedback; Query expansion; Concept; Context; SENTIMENT ANALYSIS; FUSION; ATTENTION;
D O I
10.1007/s11042-023-17256-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent technological advancements have led to a significant increase in the quantity and accessibility of videos. The decrease in video acquisition costs and the increase in memory capacity have made it possible to store large video collections in computer systems. To effectively exploit these collections, it is crucial to have tools that facilitate access and management. In this paper, we present a multimedia retrieval approach that prioritizes the user's needs by starting with a text-based query. The approach consists of two main parts: (i) a new multi-level and deep-semantic video classification indexing method, and (ii) a query expansion mechanism and relevance feedback system to improve the results based on the user's feedback. Our contribution is demonstrated through the implementation of the Deep-VISEN prototype and experiments on a collection of 2700 videos and 62838 images. The results show that our algorithm is effective and precise.
引用
收藏
页码:55811 / 55850
页数:40
相关论文
共 50 条
  • [1] Efficient text-based query based on multi-level and deep-semantic multimedia indexing and retrieval
    Mohamed Hamroun
    Sonia Lajmi
    Maryam Jallouli
    Abdelbaki Souid
    Multimedia Tools and Applications, 2024, 83 : 55811 - 55850
  • [2] A Music Search Engine based on Semantic Text-Based Query
    Buccoli, Michele
    Zanoni, Massimiliano
    Sarti, Augusto
    Tubaro, Stefano
    2013 IEEE 15TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2013, : 254 - 259
  • [3] Multi-level fusion for semantic video content indexing and retrieval
    Benmokhtar, Rachid
    Huet, Benoit
    ADAPTIVE MULTIMEDIAL RETRIEVAL: RETRIEVAL, USER, AND SEMANTICS, 2008, 4918 : 160 - 169
  • [4] External query reformulation for text-based image retrieval
    Min, Jinming
    Jones, Gareth J. F.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, 7024 LNCS : 249 - 260
  • [5] External Query Reformulation for Text-Based Image Retrieval
    Min, Jinming
    Jones, Gareth J. F.
    STRING PROCESSING AND INFORMATION RETRIEVAL, 2011, 7024 : 249 - 260
  • [6] Arabic text-based Video indexing and retrieval system enhanced by semantic content and relevance feedback
    Hamroun, Mohamed
    Lajmi, Sonia
    Nicolas, Henri
    Amous, Ikram
    2019 IEEE/ACS 16TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA 2019), 2019,
  • [7] Semantic text-based image retrieval with multi-modality ontology and DBpedia
    Aspura, Yanti Idaya M. K.
    Noah, Shahrul Azman Mohd
    ELECTRONIC LIBRARY, 2017, 35 (06): : 1191 - 1214
  • [8] Hybrid optimization and ontology-based semantic model for efficient text-based information retrieval
    Kumar, Ram
    Sharma, S. C.
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (02): : 2251 - 2280
  • [9] Hybrid optimization and ontology-based semantic model for efficient text-based information retrieval
    Ram Kumar
    S. C. Sharma
    The Journal of Supercomputing, 2023, 79 : 2251 - 2280
  • [10] Exploring automatic query refinement for text-based video retrieval
    Volkmer, Timo
    Natsev, Apostol
    2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 765 - 768