Remote sensing traffic scene retrieval based on learning control algorithm for robot multimodal sensing information fusion and human-machine interaction and collaboration

被引:2
|
作者
Peng, Huiling [1 ]
Shi, Nianfeng [1 ]
Wang, Guoqiang [1 ]
机构
[1] Luoyang Inst Sci & Technol, Sch Comp & Informat Engn, Luoyang, Peoples R China
关键词
remote sensing image processing (RSIP); multimodal sensing; robot multimodality; sensor integration and fusion; multimodal information fusion; EXTRACTION; NETWORK; IMAGES;
D O I
10.3389/fnbot.2023.1267231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In light of advancing socio-economic development and urban infrastructure, urban traffic congestion and accidents have become pressing issues. High-resolution remote sensing images are crucial for supporting urban geographic information systems (GIS), road planning, and vehicle navigation. Additionally, the emergence of robotics presents new possibilities for traffic management and road safety. This study introduces an innovative approach that combines attention mechanisms and robotic multimodal information fusion for retrieving traffic scenes from remote sensing images. Attention mechanisms focus on specific road and traffic features, reducing computation and enhancing detail capture. Graph neural algorithms improve scene retrieval accuracy. To achieve efficient traffic scene retrieval, a robot equipped with advanced sensing technology autonomously navigates urban environments, capturing high-accuracy, wide-coverage images. This facilitates comprehensive traffic databases and real-time traffic information retrieval for precise traffic management. Extensive experiments on large-scale remote sensing datasets demonstrate the feasibility and effectiveness of this approach. The integration of attention mechanisms, graph neural algorithms, and robotic multimodal information fusion enhances traffic scene retrieval, promising improved information extraction accuracy for more effective traffic management, road safety, and intelligent transportation systems. In conclusion, this interdisciplinary approach, combining attention mechanisms, graph neural algorithms, and robotic technology, represents significant progress in traffic scene retrieval from remote sensing images, with potential applications in traffic management, road safety, and urban planning.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Based On Force Sensing-Controlled Human-Machine Interaction System For Walking Assistant Robot
    Shi, Fei
    Cao, Qixin
    Leng, Chuntao
    Tan, Hongbing
    [J]. 2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 6528 - 6533
  • [2] A Scene Graph Similarity-Based Remote Sensing Image Retrieval Algorithm
    Ren, Yougui
    Zhao, Zhibin
    Jiang, Junjian
    Jiao, Yuning
    Yang, Yining
    Liu, Dawei
    Chen, Kefu
    Yu, Ge
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [3] Res-FLNet: human-robot interaction and collaboration for multi-modal sensing robot autonomous driving tasks based on learning control algorithm
    Wang, Shulei
    [J]. FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [4] IoT Wheelchair Control System Based on Multi-Mode Sensing and Human-Machine Interaction
    Cui, Jianwei
    Cui, Linwei
    Huang, Zizheng
    Li, Xiang
    Han, Fei
    [J]. MICROMACHINES, 2022, 13 (07)
  • [5] Retrieval of Water Quality Parameters Based on Near-Surface Remote Sensing and Machine Learning Algorithm
    Zhao, Yubo
    Yu, Tao
    Hu, Bingliang
    Zhang, Zhoufeng
    Liu, Yuyang
    Liu, Xiao
    Liu, Hong
    Liu, Jiacheng
    Wang, Xueji
    Song, Shuyao
    [J]. REMOTE SENSING, 2022, 14 (21)
  • [6] Human-machine Intelligent Robot System Control Based on Study Algorithm
    Yang, Xiuxia
    Yi, Zhang
    Yang, Zhiyong
    Gui, Lihua
    Gu, Wenjin
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 1016 - 1021
  • [7] Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review
    Guo, Lin
    Lu, Zongxing
    Yao, Ligang
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (04) : 300 - 309
  • [8] A Framework and Algorithm for Human-Robot Collaboration Based on Multimodal Reinforcement Learning
    Cai, Zeyuan
    Feng, Zhiquan
    Zhou, Liran
    Ai, Changsheng
    Shao, Haiyan
    Yang, Xiaohui
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [9] Flexible antibacterial degradable bioelastomer nanocomposites for ultrasensitive human-machine interaction sensing enabled by machine learning
    Fu, Zihong
    Wang, Mingcheng
    Huang, Chenlin
    Li, Zehui
    Yuan, Yue
    Hu, Shikai
    Zhang, Liqun
    Wan, Pengbo
    [J]. AGGREGATE, 2024, 5 (03):
  • [10] Image Feature Fusion Based Remote Sensing Scene Zero-Shot Classification Algorithm
    Wu Chen
    Wang Hongwei
    Yuan Yuwei
    Wang Zhiqiang
    Liu Yu
    Cheng Hong
    Quan Jicheng
    [J]. ACTA OPTICA SINICA, 2019, 39 (06)