Efficient text-based query based on multi-level and deep-semantic multimedia indexing and retrieval

被引:0
|
作者
Hamroun, Mohamed [1 ,2 ]
Lajmi, Sonia [3 ,4 ]
Jallouli, Maryam [3 ]
Souid, Abdelbaki [5 ]
机构
[1] Univ Limoges, UMR CNRS 7252, XLIM, 123 Ave Albert Thomas, F-87060 Limoges, France
[2] 3iL Grp, 43 Rue St Anne, F-87015 Limoges, France
[3] Univ Sfax, MIRACL Lab, Technopole Sfax,POB 242, Sfax, Tunisia
[4] Albaha Univ, Albaha, Saudi Arabia
[5] Gabes Univ, Natl Engn Sch Gabes, MACS Res Lab RL16ES22, Gabes 6029, Tunisia
关键词
Textual query; Classification; Semantic indexing; Relevance feedback; Query expansion; Concept; Context; SENTIMENT ANALYSIS; FUSION; ATTENTION;
D O I
10.1007/s11042-023-17256-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent technological advancements have led to a significant increase in the quantity and accessibility of videos. The decrease in video acquisition costs and the increase in memory capacity have made it possible to store large video collections in computer systems. To effectively exploit these collections, it is crucial to have tools that facilitate access and management. In this paper, we present a multimedia retrieval approach that prioritizes the user's needs by starting with a text-based query. The approach consists of two main parts: (i) a new multi-level and deep-semantic video classification indexing method, and (ii) a query expansion mechanism and relevance feedback system to improve the results based on the user's feedback. Our contribution is demonstrated through the implementation of the Deep-VISEN prototype and experiments on a collection of 2700 videos and 62838 images. The results show that our algorithm is effective and precise.
引用
收藏
页码:55811 / 55850
页数:40
相关论文
共 50 条
  • [21] Multi-level diversification approach of semantic-based image retrieval results
    Bouchakwa, Mariam
    Ayadi, Yassine
    Amous, Ikram
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2020, 9 (01) : 1 - 30
  • [22] Multi-level diversification approach of semantic-based image retrieval results
    Mariam Bouchakwa
    Yassine Ayadi
    Ikram Amous
    Progress in Artificial Intelligence, 2020, 9 : 1 - 30
  • [23] Improving Query and Assessment Quality in Text-Based Interactive Video Retrieval Evaluation
    Bailer, Werner
    Arnold, Rahel
    Benz, Vera
    Coccomini, Davide Alessandro
    Gkagkas, Anastasios
    Gudmundsson, Gylfi Thor
    Heller, Silvan
    Jonsson, Bjorn Thor
    Lokoc, Jakub
    Messina, Nicola
    Pantelidis, Nick
    Wu, Jiaxin
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 597 - 601
  • [24] Image-text matching algorithm based on multi-level semantic alignment
    Li Y.
    Yao T.
    Zhang L.
    Sun Y.
    Fu H.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (02): : 551 - 558
  • [25] AI-Based Semantic Multimedia Indexing and Retrieval for Social Media on Smartphones
    Wagenpfeil, Stefan
    Engel, Felix
    Mc Kevitt, Paul
    Hemmje, Matthias
    INFORMATION, 2021, 12 (01) : 1 - 30
  • [26] An Efficient Indexing Structure for Content Based Multimedia Retrieval with Relevance Feedback
    Nang, Jongho
    Park, Joohyoun
    APPLIED COMPUTING 2007, VOL 1 AND 2, 2007, : 517 - 524
  • [27] Multi-level supervised hashing with deep features for efficient image retrieval
    Ng, Wing W. Y.
    Li, Jiayong
    Tian, Xing
    Wang, Hui
    Kwong, Sam
    Wallace, Jonathan
    NEUROCOMPUTING, 2020, 399 : 171 - 182
  • [28] Object based image retrieval based on multi-level segmentation
    Xu, Y
    Duygulu, P
    Saber, E
    Tekalp, AM
    Yarman-Vural, FT
    2000 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS, VOLS I-VI, 2000, : 2019 - 2022
  • [29] A hybrid query approach for radiology education: Integrating content-based medical image retrieval and text-based information retrieval
    Shyu, C.-R.
    Harnsomburana, J.
    Sethi, Y.
    Singh, R.
    Reid, J.C.
    International Journal of Computers and Applications, 2002, 24 (02) : 83 - 92
  • [30] Towards AI-based Semantic Multimedia Indexing and Retrieval for Social Media on Smartphones
    Wagenpfeil, Stefan
    Hemmje, Matthias
    2020 15TH INTERNATIONAL WORKSHOP ON SEMANTIC AND SOCIAL MEDIA ADAPTATION AND PERSONALIZATION (SMAP 2020), 2020, : 7 - 15