Fast BMU Search in SOMs Using Random Hyperplane Trees

被引:0
|
作者
Astudillo, Cesar A. [1 ]
Oommen, B. John [2 ]
机构
[1] Univ Talca, Dept Comp Sci, Curico, Chile
[2] Carleton Univ, Sch Comp Sci, Ottawa, ON K1S 5B6, Canada
关键词
Approximate BMU search; Random Hyperplane Trees; SOM; TTOSOM; VQ; SELF-ORGANIZING MAPS; TOPOLOGIES; VECTOR; CLASSIFICATION; ALGORITHM; NETWORK;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most prominent Neural Networks (NNs) reported in the literature is the Kohonen's Self-Organizing Map (SOM). In spite of all its desirable capabilities and the scores of reported applications, it, unfortunately, possesses some fundamental drawbacks. Two of these handicaps are the quality of the map learned and the time required to train it. The most demanding phase of the algorithm involves determining the so-called Best Matching Unit (BMU)(1), which requires time that is proportional to the number of neurons in the NN. The focus of this paper is to reduce the time needed for this tedious task, and to attempt to obtain an approximation of the BMU is as little as logarithmic time. To achieve this, we depend heavily on the work of [3,6], where the authors focused on how to accurately learn the data distribution connecting the neurons on a self-organizing tree, and how the learning algorithm, called the Tree-based Topology-Oriented SOM (TTOSOM), can be useful for data clustering [3,6] and classification [5]. We briefly state how we intend to reduce the training time for identifying the BMU efficiently. First, we show how a novel hyperplane-based partitioning scheme can be used to accelerate the task. Unlike the existing hyperplane-based partitioning methods reported in the literature, our algorithm can avoid ill-conditioned scenarios. It is also capable of considering data points that are dynamic. We demonstrate how these hyperplanes can be recursively defined, represented and computed, so as to recursively divide the hyper-space into two halves. As far as we know, the use of random hyperplanes to identify the BMU is both pioneering and novel.
引用
收藏
页码:39 / 51
页数:13
相关论文
共 50 条
  • [1] Fast BMU search in SOMs using random hyperplane trees
    [J]. Astudillo, César A., 1600, Springer Verlag (8862):
  • [2] RANDOM HYPERPLANE SEARCH TREES
    Devroye, Luc
    King, James
    McDiarmid, Colin
    [J]. SIAM JOURNAL ON COMPUTING, 2009, 38 (06) : 2411 - 2425
  • [3] RANDOM HYPERPLANE SEARCH TREES IN HIGH DIMENSIONS
    Devroye, Luc
    King, James
    [J]. JOURNAL OF COMPUTATIONAL GEOMETRY, 2015, 6 (01) : 142 - 164
  • [4] Bregman Hyperplane Trees for Fast Approximate Nearest Neighbor Search
    Naidan, Bilegsaikhan
    Hetland, Magnus Lie
    [J]. INTERNATIONAL JOURNAL OF MULTIMEDIA DATA ENGINEERING & MANAGEMENT, 2012, 3 (04): : 75 - 87
  • [5] A Fast BMU Search for Support Vector Machine
    Kasai, Wataru
    Tobe, Yutaro
    Hasegawa, Osamu
    [J]. ARTIFICIAL NEURAL NETWORKS - ICANN 2009, PT I, 2009, 5768 : 864 - +
  • [6] Fast codeword search algorithm for ECVQ using hyperplane decision rule
    Imamura, K
    Swilem, A
    Hashimoto, H
    [J]. PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II: COMMUNICATIONS-MULTIMEDIA SYSTEMS & APPLICATIONS, 2003, : 476 - 479
  • [7] Random suffix search trees
    Devroye, L
    Neininger, R
    [J]. RANDOM STRUCTURES & ALGORITHMS, 2003, 23 (04) : 357 - 396
  • [8] Random multivariate search trees
    Devroye, Luc
    [J]. LEARNING THEORY, PROCEEDINGS, 2006, 4005 : 1 - 1
  • [9] Profiles of Random Trees: Limit Theorems for Random Recursive Trees and Binary Search Trees
    Michael Fuchs
    Hsien-Kuei Hwang
    Ralph Neininger
    [J]. Algorithmica, 2006, 46 : 367 - 407
  • [10] Profiles of random trees: Correlation and width of random recursive trees and binary search trees
    Drmota, M
    Hwang, HK
    [J]. ADVANCES IN APPLIED PROBABILITY, 2005, 37 (02) : 321 - 341