FusionPlanner: A multi-task motion planner for mining trucks via multi-sensor fusion

被引:17
|
作者
Teng, Siyu [1 ,2 ]
Li, Luxi [1 ,2 ]
Li, Yuchen [1 ,2 ]
Hu, Xuemin [3 ]
Li, Lingxi [4 ,5 ]
Ai, Yunfeng [4 ,6 ]
Chen, Long [4 ,7 ,8 ]
机构
[1] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[2] BNU HKBU United Int Coll, Dept Comp Sci, Zhuhai, Peoples R China
[3] Hubei Univ, Sch Artificial Intelligence, Wuhan, Peoples R China
[4] Waytous Inc, Beijing, Peoples R China
[5] IUPUI, Dept Elect & Comp Engn, Indianapolis, IN USA
[6] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[7] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing, Peoples R China
[8] Chinese Acad Sci, Inst Automat, State Key Lab Mulimodal Artificial Intelligence S, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Motion planning; Simulation; Multi-task; Multi-sensor;
D O I
10.1016/j.ymssp.2023.111051
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
In recent years, significant achievements have been made in motion planning for intelligent vehicles. However, as a typical unstructured environment, open -pit mining attracts limited attention due to its complex operational conditions and adverse environmental factors. A comprehensive paradigm for unmanned transportation in open -pit mines is proposed in this research. Firstly, we propose a multi -task motion planning algorithm, called FusionPlanner, for autonomous mining trucks by the multi -sensor fusion method to adapt both lateral and longitudinal control tasks for unmanned transportation. Then, we develop a novel benchmark called MiningNav, which offers three validation approaches to evaluate the trustworthiness and robustness of well -trained algorithms in transportation roads of open -pit mines. Finally, we introduce the Parallel Mining Simulator (PMS), a new high-fidelity simulator specifically designed for open -pit mining scenarios. PMS enables the users to manage and control open -pit mine transportation from both the single -truck control and multi -truck scheduling perspectives. The performance of FusionPlanner is tested by MiningNav in PMS, and the empirical results demonstrate a significant reduction in the number of collisions and takeovers of our planner. We anticipate our unmanned transportation paradigm will bring mining trucks one step closer to trustworthiness and robustness in continuous round-the-clock unmanned transportation.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Multi-Task Multi-Sensor Fusion for 3D Object Detection
    Liang, Ming
    Yang, Bin
    Chen, Yun
    Hu, Rui
    Urtasun, Raquel
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7337 - 7345
  • [2] A Detection and Tracking Method Based on Heterogeneous Multi-Sensor Fusion for Unmanned Mining Trucks
    Liu, Haitao
    Pan, Wenbo
    Hu, Yunqing
    Li, Cheng
    Yuan, Xiwen
    Long, Teng
    [J]. SENSORS, 2022, 22 (16)
  • [3] BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation
    Liu, Zhijian
    Tang, Haotian
    Amini, Alexander
    Yang, Xinyu
    Mao, Huizi
    Rus, Daniela L.
    Han, Song
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 2774 - 2781
  • [4] SFINX: A multi-sensor fusion and mining system
    Dimitrijevic, Z
    Wu, G
    Chang, EY
    [J]. ICICS-PCM 2003, VOLS 1-3, PROCEEDINGS, 2003, : 1128 - 1132
  • [5] Knowledge triple mining via multi-task learning
    Zhang, Zhao
    Zhuang, Fuzhen
    Li, Xuebing
    Niu, Zheng-Yu
    He, Jia
    He, Qing
    Xiong, Hui
    [J]. INFORMATION SYSTEMS, 2019, 80 : 64 - 75
  • [6] M2FN: An end-to-end multi-task and multi-sensor fusion network for intelligent fault diagnosis
    Cui, Jian
    Xie, Ping
    Wang, Xiao
    Wang, Jing
    He, Qun
    Jiang, Guoqian
    [J]. MEASUREMENT, 2022, 204
  • [7] A SYSTEM OF MULTI-SENSOR FUSION FOR ACTIVITY MONITORING OF INDUSTRIAL TRUCKS IN LOGISTICS WAREHOUSES
    Alias, Cyril
    Oezguer, Cagdas
    Yang, Qingjin
    Noche, Bernd
    [J]. INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2015, VOL 1B, 2016,
  • [8] Sensor Data Fusion in Multi-Sensor Weigh-In-Motion Systems
    Gajda, Janusz
    Sroka, Ryszard
    Burnos, Piotr
    [J]. SENSORS, 2020, 20 (12) : 1 - 12
  • [9] SPATIO-TEMPORALLY OPTIMIZED MULTI-SENSOR MOTION FUSION
    Sun, Xinyao
    Cheng, Irene
    Basu, Anup
    [J]. PROCEEDINGS OF 2016 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2016, : 425 - 430
  • [10] Multi-sensor fusion development
    Bish, Sheldon
    Rohrer, Matthew
    Scheffel, Peter
    Bennett, Kelly
    [J]. GROUND/AIR MULTISENSOR INTEROPERABILITY, INTEGRATION, AND NETWORKING FOR PERSISTENT ISR VII, 2016, 9831