Real-time object-to-features vectorisation via Siamese neural networks

被引:4
|
作者
Fedorenko, Fedor [1 ,3 ]
Usilin, Sergey [2 ]
机构
[1] MIPT, Dolgoprudnyi 141700, Russia
[2] Russian Acad Sci, Inst Syst Anal, Fed Res Ctr Informat & Control Syst, Moscow 117312, Russia
[3] Smart Engines Rus Ltd, Moscow 117312, Russia
关键词
computer vision; learning feature space; trainable object vectoriser; Siamese neural network;
D O I
10.1117/12.2268703
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Object-to-features vectorisation is a hard problem to solve for objects that can be hard to distinguish. Siamese and Triplet neural networks are one of the more recent tools used for such task. However, most networks used are very deep networks that prove to be hard to compute in the Internet of Things setting. In this paper, a computationally efficient neural network is proposed for real-time object-to-features vectorisation into a Euclidean metric space. We use L 2 distance to reflect feature vector similarity during both training and testing. In this way, feature vectors we develop can be easily classified using K-Nearest Neighbours classifier. Such approach can be used to train networks to vectorise such "problematic" objects like images of human faces, keypoint image patches, like keypoints on Arctic maps and surrounding marine areas.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Towards real-time object tracking with deep Siamese network and layerwise aggregation
    Yu, Lasheng
    Zhao, Yongpeng
    Zheng, Xiaopeng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (06) : 1303 - 1311
  • [42] SiamCAM: A Real-Time Siamese Network for Object Tracking with Compensating Attention Mechanism
    Huang, Kai
    Qin, Peixuan
    Tu, Xuji
    Leng, Lu
    Chu, Jun
    APPLIED SCIENCES-BASEL, 2022, 12 (08):
  • [43] Target-Specific Siamese Attention Network for Real-Time Object Tracking
    Thanikasalam, Kokul
    Fookes, Clinton
    Sridharan, Sridha
    Ramanan, Amirthalingam
    Pinidiyaarachchi, Amalka
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 1276 - 1289
  • [44] Real-Time Multiple Object Tracking with Discriminative Features
    Weng, Zhenyu
    Zhu, Yuesheng
    Lin, Zhiping
    Li, Haizhou
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 309 - 314
  • [45] Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
    Fan, Heng
    Ling, Haibin
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7944 - 7953
  • [46] Enhancing real-time CORBA via real-time Java']Java features
    Krishna, AS
    Schmidt, DC
    Klefstad, R
    24TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, PROCEEDINGS, 2004, : 66 - 73
  • [47] Real-time Small-object Change Detection from Ground Vehicles Using a Siamese Convolutional Neural Network
    Klomp, Sander R.
    van de Wouw, Dennis W. J. M.
    de With, Peter H. N.
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2019, 63 (06)
  • [48] Multiple convolutional features in Siamese networks for object tracking
    Li, Zhenxi
    Bilodeau, Guillaume-Alexandre
    Bouachir, Wassim
    MACHINE VISION AND APPLICATIONS, 2021, 32 (03)
  • [49] Drowsiness detection in real-time via convolutional neural networks and transfer learning
    Salem, Dina
    Waleed, Mohamed
    Journal of Engineering and Applied Science, 2024, 71 (01):
  • [50] Neural networks applied in real-time identification
    Dohnal, J.
    Pivonka, P.
    Annals of DAAAM for 2004 & Proceedings of the 15th International DAAAM Symposium: INTELLIGNET MANUFACTURING & AUTOMATION: GLOBALISATION - TECHNOLOGY - MEN - NATURE, 2004, : 95 - 96