Intelligent Perception System of Robot Visual Servo for Complex Industrial Environment

被引:6
|
作者
Luo, Yongchao [1 ]
Li, Shipeng [2 ]
Li, Di [2 ]
机构
[1] South China Univ Technol, Guangzhou Coll, Sch Elect Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Sch Mech & Automot Engn, Guangzhou 510641, Peoples R China
基金
国家重点研发计划;
关键词
deep learning; visual servoing; industry robot; intelligence perception; OBJECT DETECTION;
D O I
10.3390/s20247121
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robot control based on visual information perception is a hot topic in the industrial robot domain and makes robots capable of doing more things in a complex environment. However, complex visual background in an industrial environment brings great difficulties in recognizing the target image, especially when a target is small or far from the sensor. Therefore, target recognition is the first problem that should be addressed in a visual servo system. This paper considers common complex constraints in industrial environments and proposes a You Only Look Once Version 2 Region of Interest (YOLO-v2-ROI) neural network image processing algorithm based on machine learning. The proposed algorithm combines the advantages of YOLO (You Only Look Once) rapid detection with effective identification of ROI (Region of Interest) pooling structure, which can quickly locate and identify different objects in different fields of view. This method can also lead the robot vision system to recognize and classify a target object automatically, improve robot vision system efficiency, avoid blind movement, and reduce the calculation load. The proposed algorithm is verified by experiments. The experimental result shows that the learning algorithm constructed in this paper has real-time image-detection speed and demonstrates strong adaptability and recognition ability when processing images with complex backgrounds, such as different backgrounds, lighting, or perspectives. In addition, this algorithm can also effectively identify and locate visual targets, which improves the environmental adaptability of a visual servo system
引用
收藏
页码:1 / 18
页数:18
相关论文
共 50 条
  • [31] Monocular visual servo control system scheme for tethered space robot
    Research Center of Intelligent Robotics, School of Astronautics, Northwestern Polytechnical University, Xi'an
    710072, China
    不详
    710072, China
    [J]. Yuhang Xuebao, 2 (133-141):
  • [32] Visual Servo System for Ball Dribbling by Using Bipedal Robot "Nao"
    Tamura, Kazuya
    Nozaki, Takahiro
    Kawamura, Atsuo
    [J]. IECON 2015 - 41ST ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2015, : 3461 - 3466
  • [33] Design and Research of Robot Visual Servo System Based on Artificial Intelligence
    Wu, Qian
    Gu, Jinan
    [J]. AGRO FOOD INDUSTRY HI-TECH, 2017, 28 (01): : 125 - 128
  • [34] Design of Visual Servo Robot Tracking System Based on Image Feature
    Guo, Yue
    Yao, Xiaolan
    Li, Wei
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MECHATRONICS, ROBOTICS AND AUTOMATION (ICMRA 2015), 2015, 15 : 567 - 572
  • [35] Automatic sorting system for industrial robot with 3D visual perception and natural language interaction
    Lin, Yunhan
    Zhou, Haotian
    Chen, Mingyu
    Min, Huasong
    [J]. MEASUREMENT & CONTROL, 2019, 52 (1-2): : 100 - 115
  • [36] Visual Perception System of EROS Humanoid Robot Soccer
    Rizgi, Aulia Khilmi
    Risnumawan, Anhar
    Ardila, Fernando
    Sutoyo, Edi
    Wijaya, Ryan Satria
    Arifin, Ilham Fakhrul
    Anggraeni, Martianda Erste
    Herawan, Tutut
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2020, 16 (04) : 68 - 86
  • [37] Transferring Visual Knowledge for a Robust Road Environment Perception in Intelligent Vehicles
    Zhou, Wei
    Arroyo, Roberto
    Zyner, Alex
    Ward, James
    Worrall, Stewart
    Nebot, Eduardo
    Bergasa, Luis M.
    [J]. 2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [38] The Kinect-based robot environment perception system
    Peng, Li
    Zhang, Chuang
    [J]. 2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 1 - 5
  • [39] Robot in intelligent environment: Soccer robot
    Lee, Byoung-Ju
    Park, Gwi-Tae
    [J]. IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM, 1999, : 73 - 78
  • [40] Scene perception based visual navigation of mobile robot in indoor environment
    Ran, T.
    Yuan, L.
    Zhang, J. B.
    [J]. ISA TRANSACTIONS, 2021, 109 : 389 - 400