High-Dynamic-Range Tone Mapping in Intelligent Automotive Systems

被引:6
|
作者
Shopovska, Ivana [1 ]
Stojkovic, Ana [1 ]
Aelterman, Jan [1 ]
Van Hamme, David [1 ]
Philips, Wilfried [1 ]
机构
[1] Univ Ghent, IMEC, IPI, B-9000 Ghent, Belgium
关键词
high dynamic range; tone mapping; deep learning; object detection; autonomous driving; OBJECT DETECTION; OPERATOR; NETWORK;
D O I
10.3390/s23125767
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Intelligent driver assistance systems are becoming increasingly popular in modern passenger vehicles. A crucial component of intelligent vehicles is the ability to detect vulnerable road users (VRUs) for an early and safe response. However, standard imaging sensors perform poorly in conditions of strong illumination contrast, such as approaching a tunnel or at night, due to their dynamic range limitations. In this paper, we focus on the use of high-dynamic-range (HDR) imaging sensors in vehicle perception systems and the subsequent need for tone mapping of the acquired data into a standard 8-bit representation. To our knowledge, no previous studies have evaluated the impact of tone mapping on object detection performance. We investigate the potential for optimizing HDR tone mapping to achieve a natural image appearance while facilitating object detection of state-of-the-art detectors designed for standard dynamic range (SDR) images. Our proposed approach relies on a lightweight convolutional neural network (CNN) that tone maps HDR video frames into a standard 8-bit representation. We introduce a novel training approach called detection-informed tone mapping (DI-TM) and evaluate its performance with respect to its effectiveness and robustness in various scene conditions, as well as its performance relative to an existing state-of-the-art tone mapping method. The results show that the proposed DI-TM method achieves the best results in terms of detection performance metrics in challenging dynamic range conditions, while both methods perform well in typical, non-challenging conditions. In challenging conditions, our method improves the detection F2 score by 13%. Compared to SDR images, the increase in F2 score is 49%.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] High-dynamic-range characterization of ultrashort pulses
    Jung, ID
    Kartner, FX
    Henkmann, J
    Zhang, G
    Keller, U
    APPLIED PHYSICS B-LASERS AND OPTICS, 1997, 65 (02): : 307 - 310
  • [42] High-dynamic-range imaging optical detectors
    Coutinho, RC
    Selviah, DR
    Griffiths, HD
    HYBRID IMAGE AND SIGNAL PROCESSING VIII, 2002, 4735 : 41 - 50
  • [43] High-dynamic-range water window ptychography
    Rose, Max
    Dzhigaev, Dmitry
    Senkbeil, Tobias
    von Gundlach, Andreas R.
    Stuhr, Susan
    Rumancev, Christoph
    Besedin, Ilya
    Skopintsev, Petr
    Viefhaus, Jens
    Rosenhahn, Axel
    Vartanyants, Ivan A.
    X-RAY MICROSCOPY CONFERENCE 2016 (XRM 2016), 2017, 849
  • [44] Photographic High-Dynamic-Range Scalar Visualization
    Zhou, Liang
    Rivinius, Marc
    Johnson, Chris R.
    Weiskopf, Daniel
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (06) : 2156 - 2167
  • [45] Color appearance in high-dynamic-range imaging
    Akyuz, Ahmet Oguz
    Reinhard, Erik
    JOURNAL OF ELECTRONIC IMAGING, 2006, 15 (03)
  • [46] High-Dynamic-Range Integrated NV Magnetometers
    Wang, Tianning
    Liu, Zhenhua
    Liu, Yankang
    Wang, Bo
    Shen, Yuanyuan
    Qin, Li
    MICROMACHINES, 2024, 15 (05)
  • [47] High-dynamic-range image reproduction methods
    Varkonyi-Koczy, Annamaria R.
    Roevid, Andres
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2007, 56 (04) : 1465 - 1472
  • [48] Multiscale Morphological Tone Mapping Operator for High Dynamic Range Images
    Zhang, Yinghui
    Wang, Ke
    Deng, Xiaojuan
    Li, Hongwei
    THIRD INTERNATIONAL SYMPOSIUM ON IMAGE COMPUTING AND DIGITAL MEDICINE (ISICDM 2019), 2019, : 254 - 258
  • [49] Evaluation of tone mapping operators using a High Dynamic Range display
    Ledda, P
    Chalmers, A
    Troscianko, T
    Seetzen, H
    ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 640 - 648
  • [50] IMAGE CHARACTERISTIC ORIENTED TONE MAPPING FOR HIGH DYNAMIC RANGE IMAGES
    Liu, Chun Hung
    Au, Oscar C.
    Wong, P. H. W.
    Kung, M. C.
    2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4, 2008, : 1133 - 1136