Transient Attributes for High-Level Understanding and Editing of Outdoor Scenes

被引:171
|
作者
Laffont, Pierre-Yves [1 ]
Ren, Zhile [1 ]
Tao, Xiaofeng [1 ]
Qian, Chao [1 ]
Hays, James [1 ]
机构
[1] Brown Univ, Providence, RI 02912 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2014年 / 33卷 / 04期
基金
美国国家科学基金会;
关键词
image database; attribute-based image editing;
D O I
10.1145/2601097.2601101
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We live in a dynamic visual world where the appearance of scenes changes dramatically from hour to hour or season to season. In this work we study "transient scene attributes" - high level properties which affect scene appearance, such as "snow", "autumn", "dusk", "fog". We define 40 transient attributes and use crowd-sourcing to annotate thousands of images from 101 webcams. We use this "transient attribute database" to train regressors that can predict the presence of attributes in novel images. We demonstrate a photo organization method based on predicted attributes. Finally we propose a high-level image editing method which allows a user to adjust the attributes of a scene, e.g. change a scene to be "snowy" or "sunset". To support attribute manipulation we introduce a novel appearance transfer technique which is simple and fast yet competitive with the state-of-the-art. We show that we can convincingly modify many transient attributes in outdoor scenes.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] Face inpainting based on high-level facial attributes
    Jampour, Mandi
    Li, Chen
    Yu, Lap-Fai
    Zhou, Kun
    Lin, Stephen
    Bischof, Horst
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 161 : 29 - 41
  • [12] An Intelligent Assistant for High-Level Task Understanding
    Sun, Ming
    Chen, Yun-Nung
    Rudnicky, Alexander I.
    [J]. PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (IUI'16), 2016, : 169 - 174
  • [13] High-Level Concepts for Affective Understanding of Images
    Ali, Afsheen Rafaqat
    Shahid, Usman
    Ali, Mohsen
    Ho, Jeffrey
    [J]. 2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 679 - 687
  • [14] TOWARDS HIGH-LEVEL EDITING IN SYNTAX-BASED EDITORS
    DYKES, LR
    CAMERON, RD
    [J]. SOFTWARE ENGINEERING JOURNAL, 1990, 5 (04): : 237 - 244
  • [15] HIGH-LEVEL SWITCHER INTERFACE IMPROVES VIDEO EDITING TECHNIQUES
    RAYNER, B
    WHITE, D
    [J]. SMPTE JOURNAL, 1985, 94 (01): : 159 - 159
  • [16] Understanding and Predicting the Memorability of Outdoor Natural Scenes
    Lu, Jiaxin
    Xu, Mai
    Yang, Ren
    Wang, Zulin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4927 - 4941
  • [17] Shared resource access attributes for high-level contention models
    Bobrek, Alex
    Paul, Joann M.
    Thomas, Donald E.
    [J]. 2007 44TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, VOLS 1 AND 2, 2007, : 720 - +
  • [18] Decoupling strokes and high-level attributes for interactive traditional drawing
    Durand, F
    Ostromoukhov, V
    [J]. RENDERING TECHNIQUES 2001, 2001, : 71 - +
  • [19] Temporal Video Segmentation to Scenes Using High-Level Audiovisual Features
    Sidiropoulos, Panagiotis
    Mezaris, Vasileios
    Kompatsiaris, Ioannis
    Meinedo, Hugo
    Bugalho, Miguel
    Trancoso, Isabel
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (08) : 1163 - 1177
  • [20] High-level transient expression of recombinant protein in lettuce
    Joh, LD
    Wroblewski, T
    Ewing, NN
    VanderGheynst, JS
    [J]. BIOTECHNOLOGY AND BIOENGINEERING, 2005, 91 (07) : 861 - 871