Neural Network Calculations at the Speed of Light Using Optical Vector-Matrix Multiplication and Optoelectronic Activation

被引:1
|
作者
Hattori, Naoki [1 ]
Shiomi, Jun [2 ]
Masuda, Yutaka [1 ]
Ishihara, Tohru [1 ]
Shinya, Akihiko [3 ,4 ]
Notomi, Masaya [3 ,4 ]
机构
[1] Nagoya Univ, Nagoya, Aichi 4648601, Japan
[2] Kyoto Univ, Kyoto 6068501, Japan
[3] NTT Nanophoton Ctr, Atsugi, Kanagawa 2430198, Japan
[4] NTT Basic Res Labs, Atsugi, Kanagawa 2430198, Japan
关键词
neural network; optical circuit; multi-layer perceptron; wavelength division multiplexing;
D O I
10.1587/transfun.2020KEP0016
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid progress of the integrated nanophotonics technology, the optical neural network architecture has been widely investigated. Since the optical neural network can complete the inference processing just by propagating the optical signal in the network, it is expected more than one order of magnitude faster than the electronics-only implementation of artificial neural networks (ANN). In this paper, we first propose an optical vector-matrix multiplication (VMM) circuit using wavelength division multiplexing, which enables inference processing at the speed of light with ultra-wideband. This paper next proposes optoelectronic circuit implementation for batch normalization and activation function, which significantly improves the accuracy of the inference processing without sacrificing the speed performance. Finally, using a virtual environment for machine learning and an optoelectronic circuit simulator, we demonstrate the ultra-fast and accurate operation of the optical-electronic ANN circuit.
引用
收藏
页码:1477 / 1487
页数:11
相关论文
共 50 条
  • [1] VECTOR-MATRIX MULTIPLICATION IN TERNARY OPTICAL COMPUTER
    Jin, Yi
    Wang, Xian-Chao
    Peng, Jun-Jie
    Li, Mei
    Shen, Zhang-Yi
    Shan Ou-Yang
    INTERNATIONAL JOURNAL OF NUMERICAL ANALYSIS AND MODELING, 2012, 9 (02) : 401 - 409
  • [2] Fully reconfigurable coherent optical vector-matrix multiplication
    Spall, James
    Guo, Xianxin
    Barrett, Thomas D.
    Lvovsky, A. I.
    OPTICS LETTERS, 2020, 45 (20) : 5752 - 5755
  • [3] Binarized neural network of diode array with high concordance to vector-matrix multiplication
    Shin, Yunwoo
    Cho, Kyoungah
    Kim, Sangsig
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [4] Vector-Matrix Multiplication Based on a Ternary Optical Computer
    Wang, Xianchao
    Peng, Junjie
    Jin, Yi
    Li, Mei
    Shen, Zhangyi
    Ouyang, Shan
    HIGH PERFORMANCE COMPUTING AND APPLICATIONS, 2010, 5938 : 426 - +
  • [5] Balanced ternary vector-matrix multiplication on a ternary optical computer
    Li M.
    Int. J. Simul. Syst. Sci. Technol., 46 (3.1-3.4): : 3.1 - 3.4
  • [6] Active Traffic Signal Decisions Using Vector-Matrix Multiplication
    Jang, Jingon
    Jeon, Takgyeong
    Wang, Gunuk
    ADVANCED INTELLIGENT SYSTEMS, 2023, 5 (03)
  • [7] Carry-free vector-matrix multiplication on a dynamically reconfigurable optical platform
    Wang, Xianchao
    Peng, Junjie
    Li, Mei
    Shen, Zhangyi
    Shan, Ouyang
    APPLIED OPTICS, 2010, 49 (12) : 2352 - 2362
  • [8] ELECTRON-BEAM-GENERATED HOLOGRAPHIC MASKS FOR OPTICAL VECTOR-MATRIX MULTIPLICATION.
    Arnold, Steven M.
    Case, Steven K.
    Optical Engineering, 1984, 23 (01) : 079 - 082
  • [9] Influence of Weight Transfer Error on Vector-Matrix Multiplication Using AND Array Architectures
    Yu, Junsu
    Ryu, Donghyun
    Jang, Taejin
    Choi, Woo Young
    2023 SILICON NANOELECTRONICS WORKSHOP, SNW, 2023, : 41 - 42
  • [10] Optoelectronic large-scale neurocoprocessor for microcomputer on an optical vector-matrix multiplier base
    Bezrodnov, NV
    Gunko, MV
    Rozhkov, OV
    OPTICAL MEMORY AND NEURAL NETWORKS, 1998, 3402 : 259 - 270