One-vs-One, One-vs-Rest, and a novel Outcome-Driven One-vs-One binary classifiers enabled by optoelectronic memristors towards overcoming hardware limitations in multiclass classification

被引:0
|
作者
Psaltakis G. [1 ]
Rogdakis K. [1 ]
Loizos M. [1 ]
Kymakis E. [1 ]
机构
[1] Computer Engineering, Hellenic Mediterranean University (HMU), Crete, Heraklion
[2] Institute of Emerging Technologies (I-EMERGE), University Research and Innovation Center, HMU, Crete, Heraklion
来源
Discover Materials | / 4卷 / 1期
基金
欧盟地平线“2020”;
关键词
D O I
10.1007/s43939-024-00077-7
中图分类号
学科分类号
摘要
Deep neural networks have achieved considerable success over the past ten years in a variety of fields. However, current state-of-the-art artificial intelligence (AI) systems require large computing hardware infrastructure and high power consumption. To overcome these hurdles, it is required to adopt new strategies such as designing novel computation architectures and developing building blocks that can mimic the low energy consumption of biological systems. On the architecture level, implementing classification tasks by splitting the problem into simpler subtasks is a way to relax hardware constraints despite the less accuracy of the approach. On the computation unit level, memristive devices are a promising technology for low power neuromorphic computation. Hereby, we combine both these two approaches and present a novel algorithmic approach for multiclass classification tasks through splitting the problem into binary subtasks while using optoelectronics memristors as synapses. Our approach leverages the core fundamentals from the One-vs-One (OvO) and the One-vs-Rest (OvR) classification strategies towards a novel Outcome-Driven One-vs-One (ODOvO) approach. The light modulation of synaptic weights, fed in our algorithm from experimental data, is a key enabling parameter that permits classification without modifying further applied electrical biases. Our approach requires at least a 10X less synapses (only 196 synapses are required) while reduces the classification time by up to N2 compared to conventional memristors. We show that the novel ODOvO algorithm has similar accuracies to OvO (reaching over 60% on the MNIST dataset) while requiring even fewer iterations compared to the OvR. Consequently, our approach constitutes a feasible solution for neural networks where key priorities are the minimum energy consumption i.e., small iterations number, fast execution, and the low hardware requirements allowing experimental verification. © The Author(s) 2024.
引用
收藏
相关论文
共 50 条
  • [1] One-vs-One classification for deep neural networks
    Pawara, Pornntiwa
    Okafor, Emmanuel
    Groefsema, Marc
    He, Sheng
    Schomaker, Lambert R. B.
    Wiering, Marco A.
    [J]. PATTERN RECOGNITION, 2020, 108
  • [2] PHASE TRANSITIONS FOR ONE-VS-ONE AND ONE-VS-ALL LINEAR SEPARABILITY IN MULTICLASS GAUSSIAN MIXTURES
    Kini, Ganesh Ramachandra
    Thrampoulidis, Christos
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4020 - 4024
  • [3] A Study of Different Families of Fusion Functions for Combining Classifiers in the One-vs-One Strategy
    Uriz, Mikel
    Paternain, Daniel
    Jurio, Aranzazu
    Bustince, Humberto
    Galar, Mikel
    [J]. INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS: THEORY AND FOUNDATIONS, PT II, 2018, 854 : 427 - 440
  • [4] Gait Identification using One-vs-one Classifier Model
    Raziff, Abdul Rafiez Abdul
    Sulaiman, Md Nasir
    Mustapha, Norwati
    Perumal, Thinagaran
    [J]. 2016 IEEE CONFERENCE ON OPEN SYSTEMS, 2016, : 71 - 75
  • [5] One-vs-one multiclass least squares support vector machines for direction of arrival estimation
    Rohwer, JA
    Abdallah, CT
    [J]. APPLIED COMPUTATIONAL ELECTROMAGNETICS SOCIETY JOURNAL, 2003, 18 (02): : 98 - 109
  • [6] An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes
    Galar, Mikel
    Fernandez, Alberto
    Barrenechea, Edurne
    Bustince, Humberto
    Herrera, Francisco
    [J]. PATTERN RECOGNITION, 2011, 44 (08) : 1761 - 1776
  • [7] Addressing the Overlapping Data Problem in Classification Using the One-vs-One Decomposition Strategy
    Saez, Jose A.
    Galar, Mikel
    Krawczyk, Bartosz
    [J]. IEEE ACCESS, 2019, 7 : 83396 - 83411
  • [8] Dynamic classifier selection for One-vs-One strategy: Avoiding non-competent classifiers
    Galar, Mikel
    Fernandez, Alberto
    Barrenechea, Edurne
    Bustince, Humberto
    Herrera, Francisco
    [J]. PATTERN RECOGNITION, 2013, 46 (12) : 3412 - 3424
  • [9] EFFICIENT ONE-VS-ONE KERNEL RIDGE REGRESSION FOR SPEECH RECOGNITION
    Chen, Jie
    Wu, Lingfei
    Audhkhasi, Kartik
    Kingsbury, Brian
    Ramabhadran, Bhuvana
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 2454 - 2458
  • [10] An Application of One-vs-One Method in Automated Taxa Identification of Macroinvertebrates
    Joutsijoki, Henry
    [J]. 2013 FOURTH GLOBAL CONGRESS ON INTELLIGENT SYSTEMS (GCIS), 2013, : 125 - 130