MirBot: A Multimodal Interactive Image Retrieval System

被引:0
|
作者
Pertusa, Antonio [1 ]
Gallego, Antonio-Javier [1 ]
Bernabeu, Marisa [1 ]
机构
[1] Univ Alicante, DLSI, Alicante, Spain
关键词
Image retrieval; multimodality; interactive labeling; SCALE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study presents a multimodal interactive image retrieval system for smartphones (MirBot). The application is designed as a collaborative game where users can categorize photographs according to the WordNet hierarchy. After taking a picture, the region of interest of the target can be selected, and the image information is sent with a set of metadata to a server in order to classify the object. The user can validate the category proposed by the system to improve future queries. The result is a labeled database with a structure similar to ImageNet, but with contents selected by the users, fully marked with regions of interest, and with novel metadata that can be useful to constrain the search space in a future work. The MirBot app is freely available on the Apple app store.
引用
收藏
页码:197 / 204
页数:8
相关论文
共 50 条
  • [1] Multimodal medical image retrieval system
    Kitanovski, Ivan
    Strezoski, Gjorgji
    Dimitrovski, Ivica
    Madjarov, Gjorgji
    Loskovska, Suzana
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (02) : 2955 - 2978
  • [2] Multimodal medical image retrieval system
    Ivan Kitanovski
    Gjorgji Strezoski
    Ivica Dimitrovski
    Gjorgji Madjarov
    Suzana Loskovska
    [J]. Multimedia Tools and Applications, 2017, 76 : 2955 - 2978
  • [3] Interactive radiographic image retrieval system
    Kundu, Malay Kumar
    Chowdhury, Manish
    Das, Sudeb
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2017, 139 : 209 - 220
  • [4] MIRROR: An interactive content based image retrieval system
    Wong, KM
    Cheung, KW
    Po, LM
    [J]. 2005 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), VOLS 1-6, CONFERENCE PROCEEDINGS, 2005, : 1541 - 1544
  • [5] Interactive Image Retrieval System Based on Multiple Features
    Xie, Yichen
    [J]. 2016 IEEE 20TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2016, : 427 - 430
  • [6] Img(Rummager): An Interactive Content Based Image Retrieval System
    Chatzichristofis, Savvas A.
    Boutalis, Yiannis S.
    Lux, Mathias
    [J]. SISAP 2009: 2009 SECOND INTERNATIONAL WORKSHOP ON SIMILARITY SEARCH AND APPLICATIONS, PROCEEDINGS, 2009, : 151 - +
  • [7] Interactive image retrieval in large astronomical archives: The ASPECT system
    Csillaghy, A
    Benz, AO
    [J]. SOLAR PHYSICS, 1999, 188 (01) : 203 - 216
  • [8] Towards interactive image query system for content-based image retrieval
    Kawanobe, Fumihiho
    Takano, Shigeru
    Okada, Yoshihiro
    [J]. PROCEEDINGS 2009 FOURTH INTERNATIONAL WORKSHOP ON SEMANTIC MEDIA ADAPTATION AND PERSONALIZATION, 2009, : 56 - 61
  • [9] Interactive image retrieval in large astronomical archives: The Aspect system
    A. Csillaghy
    A.O. Benz
    [J]. Solar Physics, 1999, 188 : 203 - 216
  • [10] Image retrieval system based on interactive reduction of feature space
    Kobayashi, A
    Yoshida, T
    Sakai, Y
    [J]. STORAGE AND RETRIEVAL FOR IMAGE AND VIDEO DATABASES VII, 1998, 3656 : 593 - 602