Remote sensing traffic scene retrieval based on learning control algorithm for robot multimodal sensing information fusion and human-machine interaction and collaboration

被引:2
|
作者
Peng, Huiling [1 ]
Shi, Nianfeng [1 ]
Wang, Guoqiang [1 ]
机构
[1] Luoyang Inst Sci & Technol, Sch Comp & Informat Engn, Luoyang, Peoples R China
关键词
remote sensing image processing (RSIP); multimodal sensing; robot multimodality; sensor integration and fusion; multimodal information fusion; EXTRACTION; NETWORK; IMAGES;
D O I
10.3389/fnbot.2023.1267231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In light of advancing socio-economic development and urban infrastructure, urban traffic congestion and accidents have become pressing issues. High-resolution remote sensing images are crucial for supporting urban geographic information systems (GIS), road planning, and vehicle navigation. Additionally, the emergence of robotics presents new possibilities for traffic management and road safety. This study introduces an innovative approach that combines attention mechanisms and robotic multimodal information fusion for retrieving traffic scenes from remote sensing images. Attention mechanisms focus on specific road and traffic features, reducing computation and enhancing detail capture. Graph neural algorithms improve scene retrieval accuracy. To achieve efficient traffic scene retrieval, a robot equipped with advanced sensing technology autonomously navigates urban environments, capturing high-accuracy, wide-coverage images. This facilitates comprehensive traffic databases and real-time traffic information retrieval for precise traffic management. Extensive experiments on large-scale remote sensing datasets demonstrate the feasibility and effectiveness of this approach. The integration of attention mechanisms, graph neural algorithms, and robotic multimodal information fusion enhances traffic scene retrieval, promising improved information extraction accuracy for more effective traffic management, road safety, and intelligent transportation systems. In conclusion, this interdisciplinary approach, combining attention mechanisms, graph neural algorithms, and robotic technology, represents significant progress in traffic scene retrieval from remote sensing images, with potential applications in traffic management, road safety, and urban planning.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Remote sensing retrieval based on machine learning algorithm:Uncertainty analysis
    Wang J.
    Wu X.
    Ma D.
    Wen J.
    Xiao Q.
    National Remote Sensing Bulletin, 2023, 27 (03) : 724 - 737
  • [2] Based On Force Sensing-Controlled Human-Machine Interaction System For Walking Assistant Robot
    Shi, Fei
    Cao, Qixin
    Leng, Chuntao
    Tan, Hongbing
    2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 6528 - 6533
  • [3] A Scene Graph Similarity-Based Remote Sensing Image Retrieval Algorithm
    Ren, Yougui
    Zhao, Zhibin
    Jiang, Junjian
    Jiao, Yuning
    Yang, Yining
    Liu, Dawei
    Chen, Kefu
    Yu, Ge
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [4] Multifunctional Sensing Platform Based on Single Antenna for Noncontact Human-Machine Interaction and Environment Sensing
    Dang, Yu
    Cheffena, Michael
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2024, 72 (10) : 7664 - 7679
  • [5] Res-FLNet: human-robot interaction and collaboration for multi-modal sensing robot autonomous driving tasks based on learning control algorithm
    Wang, Shulei
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [6] IoT Wheelchair Control System Based on Multi-Mode Sensing and Human-Machine Interaction
    Cui, Jianwei
    Cui, Linwei
    Huang, Zizheng
    Li, Xiang
    Han, Fei
    MICROMACHINES, 2022, 13 (07)
  • [7] Retrieval of Water Quality Parameters Based on Near-Surface Remote Sensing and Machine Learning Algorithm
    Zhao, Yubo
    Yu, Tao
    Hu, Bingliang
    Zhang, Zhoufeng
    Liu, Yuyang
    Liu, Xiao
    Liu, Hong
    Liu, Jiacheng
    Wang, Xueji
    Song, Shuyao
    REMOTE SENSING, 2022, 14 (21)
  • [8] Interactive Haptic System with Multimodal Tactile Sensing and Hydraulic Feedback for Realistic Human-Machine Interaction
    Jeong, Jingu
    Kang, Mingyu
    Song, Youngsup
    Pyo, Soonjae
    ADVANCED INTELLIGENT SYSTEMS, 2024,
  • [9] Human-machine Intelligent Robot System Control Based on Study Algorithm
    Yang, Xiuxia
    Yi, Zhang
    Yang, Zhiyong
    Gui, Lihua
    Gu, Wenjin
    2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 1016 - 1021
  • [10] Remote sensing image fusion algorithm based on human visual characteristic
    Wang, Jin-Ling
    Xu, Shu-Yan
    He, Xiao-Jun
    Guangdianzi Jiguang/Journal of Optoelectronics Laser, 2010, 21 (09): : 1390 - 1395