Fast and robust duplicate image detection on the web

被引:2
|
作者
Gadeski, Etienne [1 ]
Le Borgne, Herve [1 ]
Popescu, Adrian [1 ]
机构
[1] CEA, Vis & Content Engn Lab, LIST, Gif Sur Yvette, France
关键词
Social media intelligence; Near duplicate detection; Copy detection; Visual web data; Image retrieval;
D O I
10.1007/s11042-016-3619-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Social media intelligence is interested in detecting the massive propagation of similar visual content. It can be seen, under certain conditions, as a problem of detecting near duplicate images in a stream of web data. However, in the context considered, it requires not only an efficient indexing and searching algorithm but also to be fast to compute the image description, since the total time of description and searching must be short enough to satisfy the constraint induced by the web stream flow rate. While most of methods of the state of the art focus on the efficiency at searching time, we propose a new descriptor satisfying the aforementioned requirements. We evaluate our method on two different datasets with the use of different sets of distractor images, leading to large-scale image collections (up to 100 million images). We compare our method to the state of the art and show it exhibits among the best detection performances but is much faster (one to two orders of magnitude).
引用
收藏
页码:11839 / 11858
页数:20
相关论文
共 50 条
  • [21] Automating Duplicate Detection for Lexical Heterogeneous Web Databases
    Ahlawat A.
    Sagar K.
    Recent Advances in Computer Science and Communications, 2022, 15 (04) : 540 - 549
  • [22] Web Document Duplicate Detection Using Fuzzy Hashing
    Figuerola, Carlos G.
    Gomez Diaz, Raquel
    Alonso Berrocal, Jose L.
    Zazo Rodriguez, Angel F.
    TRENDS IN PRACTICAL APPLICATIONS OF AGENTS AND MULTI-AGENTS SYSTEMS, 2011, 90 : 117 - 125
  • [23] Efficient and Robust Detection of Duplicate Videos in a Large Database
    Sarkar, Anindya
    Singh, Vishwarkarma
    Ghosh, Pratim
    Manjunath, Bangalore S.
    Singh, Ambuj
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (06) : 870 - 885
  • [24] UVPAR:: fast detection of functional shifts in duplicate genes
    Arnau, Vicente
    Gallach, Miguel
    Lucas, J. Ignasi
    Marin, Ignacio
    BMC BIOINFORMATICS, 2006, 7 (1)
  • [25] Fast and robust bore detection in range image data for industrial automation
    Biegelbauer, G
    Vincze, M
    2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 526 - 533
  • [26] UVPAR: fast detection of functional shifts in duplicate genes
    Vicente Arnau
    Miguel Gallach
    J Ignasi Lucas
    Ignacio Marín
    BMC Bioinformatics, 7
  • [27] Fast Duplicate Detection Using Locality Sensitive Hashing
    Rong, C. T.
    Feng, L. J.
    INTERNATIONAL CONFERENCE ON ADVANCED EDUCATIONAL TECHNOLOGY AND INFORMATION ENGINEERING (AETIE 2015), 2015, : 580 - 588
  • [28] Fixing the Threshold for Effective Detection of Near Duplicate Web Documents in Web Crawling
    Narayana, V. A.
    Premchand, P.
    Govardhan, A.
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2010, PT I, 2010, 6440 : 169 - 180
  • [29] A fast and precise spatial verification strategy for duplicate image retrieval
    Chen M.
    Zhang Z.
    Gao T.
    Duan L.
    Zhang J.
    Chen, Ming (cm19834@163.com), 1600, Totem Publishers Ltd (16): : 1393 - 1403
  • [30] Fast and Robust Image Identification
    Brasnett, Paul
    Bober, Miroslaw
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 871 - 875