An intelligent vision recognition method based on deep learning for pointer meters

被引:15
|
作者
Chen, Leisheng [1 ]
Wu, Xing [1 ]
Sun, Chao [2 ]
Zou, Ting [3 ]
Meng, Kai [1 ]
Lou, Peihuang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Mech & Elect Engn, Nanjing, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, Shanghai, Peoples R China
[3] Mem Univ Newfoundland, Dept Mech Engn, St John, NF, Canada
基金
中国国家自然科学基金;
关键词
vision recognition; meter reading; image segmentation; object detection; U-2-Net; ROBUST;
D O I
10.1088/1361-6501/acb80b
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Nowadays, pointer instruments remain the main state monitoring devices in the power industry, because they have strong mechanical stability to resist electromagnetic interferences compared with digital instruments. Although the object detection algorithms based on deep learning have widely been used in the field of instrument detection, the meter recognition process still relies on threshold segmentation to recognize object points and on Hough transform to extract the meter pointer. An intelligent vision recognition method based on YOLOv5 and U-2-Net network (YLU2-Net) is proposed to improve the accuracy and efficiency of meter recognition in a complex environment. Firstly, the pointer meter is located in the instrument images by using the YOLOv5 network as a region of interest (RoI). Then, the instrument RoI is processed by means of perspective transformation and image resizing. Thirdly, an improved U-2-Net image segmentation method with the deep separable convolution and the focal loss function is devised to distinguish the pointers and scales from the background in the instrument RoI. Further, a dimension reduction reading method with the polar coordinate transformation is developed to calculate the meter reading accurately and efficiently. Finally, the ablation experiment is conducted to test the performance of each algorithm module in our method, and the competition experiment is completed to compare our method with other state-of-the-art ones. The experimental results verify the accuracy and efficiency of the YLU2-Net recognition method proposed.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Image Recognition and Reading of Single Pointer Meter Based on Deep Learning
    Fan, Huahao
    Li, Yuan
    IEEE SENSORS JOURNAL, 2024, 24 (15) : 25163 - 25174
  • [22] Tilt Correction Method of Pointer Meter Based on Deep Learning
    Zhou D.
    Yang Y.
    Zhu J.
    Wang K.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (12): : 1976 - 1984
  • [23] Deep Learning-based Intelligent Reading Recognition Method of the Digital Multimeter
    Zhou, Wei
    Peng, Jianqing
    Han, Yu
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 3272 - 3277
  • [24] Intelligent Noncontact Structural Displacement Detection Method Based on Computer Vision and Deep Learning
    Liu, Hongbo
    Zhang, Fan
    Ma, Rui
    Wang, Longxuan
    Chen, Zhihua
    Zhang, Qian
    Guo, Liulu
    JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2024, 150 (10)
  • [25] A Novel Scale Recognition Method for Pointer Meters Adapted to Different Types and Shapes
    Lai, HaoWen
    Kang, Qi
    Pan, Le
    Cui, Can
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2019, : 374 - 379
  • [26] A deep learning method for pointer meter reading recognition in inspection robots at refrigeration stations
    Wang, Kai
    Yu, Junqi
    Feng, Chunyong
    Guo, Jvgang
    Chen, Yisheng
    Dong, Zhenping
    Liu, Zongyi
    Engineering Research Express, 2024, 6 (04):
  • [27] Auto-recognition Method for Pointer-type Meter Based on Binocular Vision
    Yang, Biao
    Lin, Guoyu
    Zhang, Weigong
    JOURNAL OF COMPUTERS, 2014, 9 (04) : 787 - 793
  • [28] Method for detecting and recognizing pointer meter reading based on deep learning
    Liu, Hang
    Huang, Zhenlin
    Tian, Lin
    Chen, Baohao
    Jiang, Haijiao
    Ren, Weihua
    THIRD INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION; NETWORK AND COMPUTER TECHNOLOGY (ECNCT 2021), 2022, 12167
  • [29] An Intelligent Methods for Pointer Instrument Reading Based on Machine Vision
    Liu, Huanjun
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON MODELING, SIMULATION AND OPTIMIZATION TECHNOLOGIES AND APPLICATIONS (MSOTA2016), 2016, 58 : 393 - 396
  • [30] An Online Intelligent Kinematic Calibration Method for Quadruped Robots Based on Machine Vision and Deep Learning
    Xu, Handing
    Nie, Zhenguo
    Cui, Xinyu
    Lee, ShiKeat
    Meng, Qizhi
    Xie, Fugui
    Liu, Xin-Jun
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2021, PT IV, 2021, 13016 : 338 - 344