Intelligent Perception System of Robot Visual Servo for Complex Industrial Environment

被引:6
|
作者
Luo, Yongchao [1 ]
Li, Shipeng [2 ]
Li, Di [2 ]
机构
[1] South China Univ Technol, Guangzhou Coll, Sch Elect Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Sch Mech & Automot Engn, Guangzhou 510641, Peoples R China
基金
国家重点研发计划;
关键词
deep learning; visual servoing; industry robot; intelligence perception; OBJECT DETECTION;
D O I
10.3390/s20247121
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robot control based on visual information perception is a hot topic in the industrial robot domain and makes robots capable of doing more things in a complex environment. However, complex visual background in an industrial environment brings great difficulties in recognizing the target image, especially when a target is small or far from the sensor. Therefore, target recognition is the first problem that should be addressed in a visual servo system. This paper considers common complex constraints in industrial environments and proposes a You Only Look Once Version 2 Region of Interest (YOLO-v2-ROI) neural network image processing algorithm based on machine learning. The proposed algorithm combines the advantages of YOLO (You Only Look Once) rapid detection with effective identification of ROI (Region of Interest) pooling structure, which can quickly locate and identify different objects in different fields of view. This method can also lead the robot vision system to recognize and classify a target object automatically, improve robot vision system efficiency, avoid blind movement, and reduce the calculation load. The proposed algorithm is verified by experiments. The experimental result shows that the learning algorithm constructed in this paper has real-time image-detection speed and demonstrates strong adaptability and recognition ability when processing images with complex backgrounds, such as different backgrounds, lighting, or perspectives. In addition, this algorithm can also effectively identify and locate visual targets, which improves the environmental adaptability of a visual servo system
引用
收藏
页码:1 / 18
页数:18
相关论文
共 50 条
  • [1] Research of Visual Servo Control System for Space Intelligent Robot
    Liang Changchun
    Zhang Xiaodong
    Pan Dong
    Liu Xin
    [J]. 2015 IEEE ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2015, : 96 - 100
  • [2] Study on Visual Navigation System for Intelligent Robot in the Unstructured Environment
    Tan, Qimeng
    Wei, Qing-qing
    Ma, Ruqi
    Chen, Lei
    Wang, Yaobing
    Lin, Yimin
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 1618 - 1623
  • [3] An Intelligence Image Processing Method of Visual Servo System in Complex Environment
    Li, Shipeng
    Li, Di
    Zhang, Chunhua
    Wang, Juan
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (18) : 17370 - 17377
  • [4] Visual Perception Framework for an Intelligent Mobile Robot
    Lee, Chung-Yeon
    Lee, Hyundo
    Hwang, Injune
    Zhang, Byoung-Tak
    [J]. 2020 17TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2020, : 612 - 616
  • [5] An intelligent visual servo control system for quadrotors
    Yuksel, Tolga
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2019, 41 (01) : 3 - 13
  • [6] Visual servo control system of space robot
    You, B
    [J]. PROCESS CONTROL AND INSPECTION FOR INDUSTRY, 2000, 4222 : 202 - 208
  • [7] Research on Intelligent Glue-coating Robot Based on Visual Servo
    Yang, Zhigang
    An, Yi
    Sun, Yanbin
    Zhang, Jingchun
    [J]. INTERNATIONAL CONFERENCE ON APPLIED PHYSICS AND INDUSTRIAL ENGINEERING 2012, PT C, 2012, 24 : 2165 - 2171
  • [8] Superordinate Safety System for Human Robot Interaction in Complex Industrial Environment
    Bdiwi, Mohamad
    Krusche, Sebastian
    Halim, Jayanto
    Ihlenfeldt, Steffen
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON ROBOTIC AND SENSORS ENVIRONMENTS (ROSE), 2022,
  • [9] Visual Servo System of Water Washing Robot for Substation
    Wang, Zhenli
    Mu, Shiyou
    Ren, Jie
    Lu, Shouyin
    Li, Jian
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL INDUSTRIAL INFORMATICS AND COMPUTER ENGINEERING CONFERENCE, 2015, : 1201 - 1204
  • [10] Brain surgical robot system based on visual servo
    Wang Dong-shu
    Pan Feng
    Xiang Long-jiang
    Xu Xin-he
    [J]. PROCEEDINGS OF 2004 CHINESE CONTROL AND DECISION CONFERENCE, 2004, : 861 - 864