REAL-TIME ENHANCEMENT OF IMAGE AND VIDEO SALIENCY USING SEMANTIC DEPTH OF FIELD

被引:0
|
作者
Su, Zhaolin [1 ]
Takahashi, Shigeo [1 ]
机构
[1] Univ Tokyo, Grad Sch Frontier Sci, Tokyo, Japan
关键词
Visual attention; Attention guidance; Saliency maps; Importance maps; Semantic depth of field; VISUAL-ATTENTION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a method for automatically directing viewers' visual attention to important regions of images and videos in low-level vision. Inspired by the modern model of visual attention, the importance map of an input scene is automatically calculated by the combination of low-level features such as intensity and color, which are extracted using spatial filters in different spatial frequencies, together with a set of temporal features extracted using a temporal filter in case of dynamic scenes. A variable-kernel-convolution based on the importance map is then performed on the input scene, in order to make semantic depth of field effects in a way that important regions remain focused while others are blurred. The pipeline of our method is efficient enough to be executed in real time on modem low-end machines, and the associated experiment demonstrates that the proposed system can be complementary to the human visual system.
引用
收藏
页码:370 / 375
页数:6
相关论文
共 50 条
  • [1] Real-time adaptive video image enhancement
    Garside, JR
    Harrison, C
    [J]. ENHANCED AND SYNTHETIC VISION 1999, 1999, 3691 : 138 - 148
  • [2] An Image-to-video Model for Real-Time Video Enhancement
    She, Dongyu
    Xu, Kun
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1837 - 1846
  • [3] Fast video enhancement algorithm using real-time image restoration framework
    Kim, S
    Paik, J
    [J]. PROCEEDINGS OF THE 2002 IEEE 10TH DIGITAL SIGNAL PROCESSING WORKSHOP & 2ND SIGNAL PROCESSING EDUCATION WORKSHOP, 2002, : 108 - 113
  • [4] Optimized contrast enhancement for real-time image and video dehazing
    Kim, Jin-Hwan
    Jang, Won-Dong
    Sim, Jae-Young
    Kim, Chang-Su
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2013, 24 (03) : 410 - 425
  • [5] USING OPAQUE IMAGE BLUR FOR REAL-TIME DEPTH-OF-FIELD RENDERING
    Kraus, Martin
    [J]. GRAPP 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2011, : 153 - 159
  • [6] Real-time saliency-aware video abstraction
    Hanli Zhao
    Xiaoyang Mao
    Xiaogang Jin
    Jianbing Shen
    Feifei Wei
    Jieqing Feng
    [J]. The Visual Computer, 2009, 25 : 973 - 984
  • [7] Real-time saliency-aware video abstraction
    Zhao, Hanli
    Mao, Xiaoyang
    Jin, Xiaogang
    Shen, Jianbing
    Wei, Feifei
    Feng, Jieqing
    [J]. VISUAL COMPUTER, 2009, 25 (11): : 973 - 984
  • [8] Adaptive image enhancement algorithms and their implementation for real-time video signals
    Kuroda, I
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2001, E84A (02) : 390 - 399
  • [9] Real time video summarizing using image semantic segmentation for CBVR
    Jain, Rahul
    Jain, Pooja
    Kumar, Tapan
    Dhiman, Gaurav
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (05) : 1827 - 1836
  • [10] Real time video summarizing using image semantic segmentation for CBVR
    Rahul Jain
    Pooja Jain
    Tapan Kumar
    Gaurav Dhiman
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 1827 - 1836