Scaling up instance annotation via label propagation

被引:2
|
作者
Papadopoulos, Dim P. [1 ]
Weber, Ethan [1 ]
Torralba, Antonio [1 ]
机构
[1] MIT CSAIL, Cambridge, MA 02139 USA
关键词
D O I
10.1109/ICCV48922.2021.01508
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manually annotating object segmentation masks is very time-consuming. While interactive segmentation methods offer a more efficient alternative, they become unaffordable at a large scale because the cost grows linearly with the number of annotated masks. In this paper, we propose a highly efficient annotation scheme for building large datasets with object segmentation masks. At a large scale, images contain many object instances with similar appearance. We exploit these similarities by using hierarchical clustering on mask predictions made by a segmentation model. We propose a scheme that efficiently searches through the hierarchy of clusters and selects which clusters to annotate. Humans manually verify only a few masks per cluster, and the labels are propagated to the whole cluster. Through a large-scale experiment to populate 1M unlabeled images with object segmentation masks for 80 object classes, we show that (1) we obtain 1M object segmentation masks with an total annotation time of only 290 hours; (2) we reduce annotation time by 76x compared to manual annotation; (3) the segmentation quality of our masks is on par with those from manually annotated datasets. Code, data, and models are available online(1).
引用
收藏
页码:15344 / 15353
页数:10
相关论文
共 50 条
  • [1] Instance Annotation for Multi-Instance Multi-Label Learning
    Briggs, Forrest
    Fern, Xiaoli Z.
    Raich, Raviv
    Lou, Qi
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2013, 7 (03)
  • [2] SIMULTANEOUS INSTANCE ANNOTATION AND CLUSTERING IN MULTI-INSTANCE MULTI-LABEL LEARNING
    Pham, Anh T.
    Raich, Raviv
    Fern, Xiaoli Z.
    [J]. 2015 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2015,
  • [3] Dynamic Programming for Instance Annotation in Multi-Instance Multi-Label Learning
    Pham, Anh T.
    Raich, Raviv
    Fern, Xiaoli Z.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2381 - 2394
  • [4] Instance-Level Label Propagation with Multi-Instance Learning
    Wang, Qifan
    Chechik, Gal
    Sun, Chen
    Shen, Bin
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2943 - 2949
  • [5] Image Annotation Using Label Propagation Algorithm
    Marukatat, Sanparith
    [J]. ECTI-CON 2008: PROCEEDINGS OF THE 2008 5TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2008, : 57 - 60
  • [6] KERNEL-BASED INSTANCE ANNOTATION IN MULTI-INSTANCE MULTI-LABEL LEARNING
    Pham, Anh T.
    Raich, Raviv
    [J]. 2014 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2014,
  • [7] Motion-region annotation for complex videos via label propagation across occluders
    Muhammad Habib Mahmood
    Yago Diéz
    Arnau Oliver
    Joaquim Salvi
    Xavier Lladó
    [J]. Machine Vision and Applications, 2023, 34
  • [8] Motion-region annotation for complex videos via label propagation across occluders
    Mahmood, Muhammad Habib
    Diez, Yago
    Oliver, Arnau
    Salvi, Joaquim
    Llado, Xavier
    [J]. MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [9] Large-scale image annotation via random forest based label propagation
    She, Qiaoqiao
    Yu, Yang
    Jiang, Yuan
    Zhou, Zhihua
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2012, 49 (11): : 2289 - 2295
  • [10] Correlative Multi-Label Multi-Instance Image Annotation
    Xue, Xiangyang
    Zhang, Wei
    Zhang, Jie
    Wu, Bin
    Fan, Jianping
    Lu, Yao
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 651 - 658