Online image search result grouping with MapReduce-based image clustering and graph construction for large-scale photos

被引:11
|
作者
Hsieh, Liang-Chi [1 ]
Wu, Guan-Long [1 ]
Hsu, Yu-Ming [1 ]
Hsu, Winston [1 ,2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Networking & Multimedia, Taipei 10617, Taiwan
[2] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
关键词
Image search result grouping; Image clustering; Representative image; Graph construction; MapReduce; Large-scale photos; Parallel affinity propagation; Image graphs;
D O I
10.1016/j.jvcir.2013.12.010
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current image search system uses paged image list to show search results. However, the problems such as query ambiguity make users hard to find search targets in such image list. In this work, we propose an image search result grouping system that summarizes image search results in semantic and visual groups. We use MapReduce-based image graph construction and image clustering methods to deal with scalability problem on this system. By precomputing image graphs and image clusters at offline stage, this system can be efficient at responding user query. The experiments on two large scale Flickr image datasets are conducted for our system. Compared with using single machine, our graph construction method is 69 times faster. We conduct a comprehensive user study to compare our approach with state-of-the-art baseline methods. We find that our approach generates competent image groups with a 2-100 times speeded-up. (C) 2013 Elsevier Inc. All rights reserved.
引用
收藏
页码:384 / 395
页数:12
相关论文
共 50 条
  • [1] MapReduce-based Dragonfly Algorithm for large-scale Data-Clustering
    Tripathi, Ashish Kumar
    Saxena, Pranav
    Gupta, Siddharth
    [J]. 2019 FIFTH INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP 2019), 2019, : 171 - 175
  • [2] A MapReduce-based artificial bee colony for large-scale data clustering
    Banharnsakun, Anan
    [J]. PATTERN RECOGNITION LETTERS, 2017, 93 : 78 - 84
  • [3] MapReduce-based large-scale online social network worm simulation
    He, Liang
    Feng, Deng-Guo
    Wang, Rui
    Su, Pu-Rui
    Ying, Ling-Yun
    [J]. He, L. (windhl@yahoo.cn), 1666, Chinese Academy of Sciences (24): : 1666 - 1682
  • [4] MapReduce-Based Crow Search-Adopted Partitional Clustering Algorithms for Handling Large-Scale Data
    Visalakshi, Karthikeyani N.
    Shanthi, S.
    Lakshmi, K.
    [J]. INTERNATIONAL JOURNAL OF COGNITIVE INFORMATICS AND NATURAL INTELLIGENCE, 2021, 15 (04)
  • [5] Graph partitioning MapReduce-based algorithms for counting triangles in large-scale graphs
    Ahmed Sharafeldeen
    Mohammed Alrahmawy
    Samir Elmougy
    [J]. Scientific Reports, 13
  • [6] Graph partitioning MapReduce-based algorithms for counting triangles in large-scale graphs
    Sharafeldeen, Ahmed
    Alrahmawy, Mohammed
    Elmougy, Samir
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [7] MapReduce-based fast fuzzy c-means algorithm for large-scale underwater image segmentation
    Li, Xiu
    Song, Jingdong
    Zhang, Fan
    Ouyang, Xiaogang
    Khan, Samee U.
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2016, 65 : 90 - 101
  • [8] MapReduce-based clustering for near-duplicate image identification
    Zhao, Wanqing
    Luo, Hangzai
    Peng, Jinye
    Fan, Jianping
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (22) : 23291 - 23307
  • [9] MapReduce-based clustering for near-duplicate image identification
    Wanqing Zhao
    Hangzai Luo
    Jinye Peng
    Jianping Fan
    [J]. Multimedia Tools and Applications, 2017, 76 : 23291 - 23307
  • [10] Scalable Implementation of a MapReduce-based Graph Processing Algorithm for Large-scale Heterogeneous Supercomputers
    Shirahata, Koichi
    Sato, Hitoshi
    Suzumura, Toyotaro
    Matsuoka, Satoshi
    [J]. PROCEEDINGS OF THE 2013 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2013), 2013, : 277 - 284