Real-time object-to-features vectorisation via Siamese neural networks

被引:4
|
作者
Fedorenko, Fedor [1 ,3 ]
Usilin, Sergey [2 ]
机构
[1] MIPT, Dolgoprudnyi 141700, Russia
[2] Russian Acad Sci, Inst Syst Anal, Fed Res Ctr Informat & Control Syst, Moscow 117312, Russia
[3] Smart Engines Rus Ltd, Moscow 117312, Russia
关键词
computer vision; learning feature space; trainable object vectoriser; Siamese neural network;
D O I
10.1117/12.2268703
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Object-to-features vectorisation is a hard problem to solve for objects that can be hard to distinguish. Siamese and Triplet neural networks are one of the more recent tools used for such task. However, most networks used are very deep networks that prove to be hard to compute in the Internet of Things setting. In this paper, a computationally efficient neural network is proposed for real-time object-to-features vectorisation into a Euclidean metric space. We use L 2 distance to reflect feature vector similarity during both training and testing. In this way, feature vectors we develop can be easily classified using K-Nearest Neighbours classifier. Such approach can be used to train networks to vectorise such "problematic" objects like images of human faces, keypoint image patches, like keypoints on Arctic maps and surrounding marine areas.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Robust real-time visual object tracking via multi-scale fully convolutional Siamese networks
    Yang, Longchao
    Jiang, Peilin
    Wang, Fei
    Wang, Xuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (17) : 22131 - 22143
  • [2] Robust real-time visual object tracking via multi-scale fully convolutional Siamese networks
    Yang, Longchao
    Jiang, Peilin
    Wang, Fei
    Wang, Xuan
    2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 225 - 231
  • [3] Robust real-time visual object tracking via multi-scale fully convolutional Siamese networks
    Longchao Yang
    Peilin Jiang
    Fei Wang
    Xuan Wang
    Multimedia Tools and Applications, 2018, 77 : 22131 - 22143
  • [4] A Twofold Siamese Network for Real-Time Object Tracking
    He, Anfeng
    Luo, Chong
    Tian, Xinmei
    Zeng, Wenjun
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4834 - 4843
  • [5] A Siamese Network for real-time object tracking on CPU
    Xing, Daitao
    Evangeliou, Nikolaos
    Tsoukalas, Athanasios
    Tzes, Anthony
    SOFTWARE IMPACTS, 2022, 12
  • [6] Real-time object tracking in the wild with Siamese network
    Han, Feng
    Jiang, Shaokui
    Wu, Jianmin
    Xu, Baile
    Zhao, Jian
    Shen, Furao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (16) : 24327 - 24343
  • [7] LightSEEN: Real-Time Unknown Traffic Discovery via Lightweight Siamese Networks
    Li, Ji
    Gu, Chunxiang
    Wei, Fushan
    Zhang, Xieli
    Hu, Xinyi
    Guo, Jiaxing
    Liu, Wenfen
    SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
  • [8] Accurate Positioning Siamese Network for Real-Time Object Tracking
    Zhou, Lijun
    Yao, Xuwen
    Zhang, Jianlin
    IEEE ACCESS, 2019, 7 : 84209 - 84216
  • [9] A Siamese-Detection Network for Real-Time Object Tracking
    Deng, Yang
    Xie, Ning
    Yang, Yang
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1669 - 1674
  • [10] Hierarchical correlation siamese network for real-time object tracking
    Meng, Yu
    Deng, Zaixu
    Zhao, Kun
    Xu, Yan
    Liu, Hao
    APPLIED INTELLIGENCE, 2021, 51 (06) : 3202 - 3211