DeepScene, DeepVis, DeepDist, And DeepReject: Image-Based Visibility Estimation System For UAV

被引:2
|
作者
Sakaino, Hidetomo [1 ]
机构
[1] Weathernews Inc, Makuhari Techno Garden, Nakase 1-3 Mihama Ward, Chiba, Chiba 2610023, Japan
关键词
Panoptic segmentation; DeepReject; DeepScene; visibility; distant object; safe flight; UAV; portable;
D O I
10.1109/AERO55745.2023.10115897
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper presents a method of multiple Deep Learning model-based visibility estimation for a fixed and drone camera under adversarial conditions. High visibility is required for safe flights at airports, cities, and fields. On the other hand, local weather conditions can suddenly vary during the flight. Fog and clouds are known to cause invisibility that impedes critical issues for flights. Due to expensive systems, visibility measurement sensors have been used at very limited airports. For this, lower-cost methods with portable apparatus have been desired for flight routines. Therefore, this paper proposes a camera-based visibility estimation method using multiple Deep Learning models. However, even state-of-the-art models can be degraded by strong illumination like sunbeams and artificial lighting. For this issue, DeepReject is introduced to exclude input images. DeepScene is proposed to apply for panoptic segmentation of objects. In DeepDist, fog levels can be estimated by apparent changes in each geo-tagged object, i.e., vehicle, and mountain. An image-data regression-based DeepVis is also proposed to apply for non-geo-tagged scenes, i.e., sky and clouds. Using four DeepXs, experimental results show the robustness, stability, and accuracy of the proposed multiple DL models for the unmanned aerial vehicle flight conditions over a single DL.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Binary-space-partitioned images for resolving image-based visibility
    Fu, CW
    Wong, TT
    Tong, WS
    Tang, CK
    Hanson, AJ
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2004, 10 (01) : 58 - 71
  • [32] An Evaluation of Image-Based Robot Orientation Estimation
    Cao, Juan
    Labrosse, Frederic
    Dee, Hannah
    TOWARDS AUTONOMOUS ROBOTIC SYSTEMS, 2014, 8069 : 135 - 147
  • [33] Image-based volume estimation for food in a bowl
    Jia, Wenyan
    Li, Boyang
    Xu, Qi
    Chen, Guangzong
    Mao, Zhi-Hong
    McCrory, Megan A.
    Baranowski, Tom
    Burke, Lora E.
    Lo, Benny
    Anderson, Alex K.
    Frost, Gary
    Sazonov, Edward
    Sun, Mingui
    JOURNAL OF FOOD ENGINEERING, 2024, 372
  • [34] Image-Based Pose Estimation of an Endoscopic Instrument
    Reilink, Rob
    Stramigioli, Stefano
    Misra, Sarthak
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 3555 - 3556
  • [35] A Minimal Solution for Image-Based Sphere Estimation
    Toth, Tekla
    Hajder, Levente
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (06) : 1428 - 1447
  • [36] Image-based visual servoing with depth estimation
    Gongye, Qingxuan
    Cheng, Peng
    Dong, Jiuxiang
    Transactions of the Institute of Measurement and Control, 2022, 44 (09): : 1811 - 1823
  • [37] A Minimal Solution for Image-Based Sphere Estimation
    Tekla Tóth
    Levente Hajder
    International Journal of Computer Vision, 2023, 131 : 1428 - 1447
  • [38] Image-based visual servoing with depth estimation
    Gongye, Qingxuan
    Cheng, Peng
    Dong, Jiuxiang
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2022, 44 (09) : 1811 - 1823
  • [39] Design Through Operation of an Image-Based Velocity Estimation System for Mars Landing
    Andrew Johnson
    Reg Willson
    Yang Cheng
    Jay Goguen
    Chris Leger
    Miguel Sanmartin
    Larry Matthies
    International Journal of Computer Vision, 2007, 74 : 319 - 341
  • [40] Design through operation of an image-based velocity estimation system for mars landing
    Johnson, Andrew
    Willson, Reg
    Cheng, Yang
    Goguen, Jay
    Leger, Chris
    Sanmartin, Miguel
    Matthies, Larry
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (03) : 319 - 341