Robotics multi-modal recognition system via computer-based vision

被引：0
|
作者：
Shahin, Mohammad [1 ]
Chen, F. Frank [1 ]
Hosseinzadeh, Ali [1 ]
Bouzary, Hamed [1 ]
Shahin, Awni [2 ]
机构：
[1] Mechanical Engineering Department, The University of Texas at San Antonio, San Antonio, United States
[2] Faculty of Education, Mu’tah University, Karak, Jordan
来源：
International Journal of Advanced Manufacturing Technology | 2024年
关键词：
This paper presents a multi-modal recognition system (MMR) which can eliminates the need for using Barcodes and Radio Frequency Identification Systems (RFIDs). Barcodes and RFID have limitations; for example, Barcodes require the scanner to have a direct line of sight with the code, and they are more susceptible to errors. Barcodes can also be hard to locate and can be affixed to oddly shaped products. While, RFID may overcome such problems, but it could be disturbed if the RFID is attached to a metallic background. The proposed MMR system can monitor items flowing one by one down on a conveyor belt to make sure they match their images, thus enabling robotics identification for items while picking them up, sorting them or turning them into a desirable orientation. Recognizing the business landscape evolves and competition from low-cost nations grows, new models must be created that provide a competitive edge by combining the Lean paradigm with Industry 4.0 technical advancements. This paper reports a contribution to this field by assessing the supporting function of MMR state-of-the-art algorithms in Lean manufacturing. In addition, this paper also aims to explore how MMR could be integrated into the Lean manufacturing settings to enable a competitive manufacturing process in a Lean 4.0 environment. A dataset with 21,000 vegetable images of 15 classes was used to present the recent development and application of image analysis and computer vision systems in object recognition, showing an overall detection F1-score of 85.08%. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Article in Press
引用
收藏
相关论文
共 50 条
  • [21] COMPUTER-BASED VISION-HISTORY SYSTEM
    SLACK, CW
    WILLIAMS, JH
    AMERICAN JOURNAL OF OPTOMETRY AND ARCHIVES OF AMERICAN ACADEMY OF OPTOMETRY, 1972, 49 (10): : 884 - &
  • [22] Footprint recognition algorithm based on multi-modal features
    Zhang Y.
    Wang Q.
    Wang N.
    Liu J.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2019, 47 (05): : 73 - 78
  • [23] Human activity recognition based on multi-modal fusion
    Cheng Zhang
    Tianqi Zu
    Yibin Hou
    Jian He
    Shengqi Yang
    Ruihai Dong
    CCF Transactions on Pervasive Computing and Interaction, 2023, 5 : 321 - 332
  • [24] Gesture recognition based on multi-modal feature weight
    Duan, Haojie
    Sun, Ying
    Cheng, Wentao
    Jiang, Du
    Yun, Juntong
    Liu, Ying
    Liu, Yibo
    Zhou, Dalin
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (05):
  • [25] Sports action recognition algorithm based on multi-modal data recognition
    Zhang, Lin
    Intelligent Decision Technologies, 2024, 18 (04) : 3243 - 3257
  • [26] An Immersive System with Multi-modal Human-computer Interaction
    Zhao, Rui
    Wang, Kang
    Divekar, Rahul
    Rouhani, Robert
    Su, Hui
    Ji, Qiang
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 517 - 524
  • [27] A Unified Biosensor-Vision Multi-Modal Transformer network for emotion recognition
    Ali, Kamran
    Hughes, Charles E.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 102
  • [28] SERVER: Multi-modal Speech Emotion Recognition using Transformer-based and Vision-based Embeddings
    Nhat Truong Pham
    Duc Ngoc Minh Dang
    Bich Ngoc Hong Pham
    Sy Dzung Nguyen
    PROCEEDINGS OF 2023 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION TECHNOLOGY, ICIIT 2023, 2023, : 234 - 238
  • [29] Robust recognition of faces and facial features with a multi-modal system
    Graf, HP
    Cosatto, E
    Potamianos, M
    SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 2034 - 2039
  • [30] Multi-modal user identification and object recognition surveillance system
    Clapes, Albert
    Reyes, Miguel
    Escalera, Sergio
    PATTERN RECOGNITION LETTERS, 2013, 34 (07) : 799 - 808
12345