uGEMM: Unary Computing Architecture for GEMM Applications

被引:32
|
作者
Wu, Di [1 ]
Li, Jingjie [1 ]
Yin, Ruokai [1 ]
Hsiao, Hsuan [2 ]
Kim, Younghyun [1 ]
San Miguel, Joshua [1 ]
机构
[1] Univ Wisconsin, Dept ECE, Madison, WI 53706 USA
[2] Univ Toronto, Dept ECE, Toronto, ON, Canada
关键词
D O I
10.1109/ISCA45697.2020.00040
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
General matrix multiplication (GEMM) is universal in various applications, such as signal processing, machine learning, and computer vision. Conventional GEMM hardware architectures based on binary computing exhibit low area and energy efficiency as they scale due to the spatial nature of number representation and computing. Unary computing, on the other hand, can be performed with extremely simple processing units, often just with a single logic gate. But currently there exist no efficient architectures for unary GEMM. In this paper, we present uGEMM, an area- and energy-efficient unary GEMM architecture enabled by novel arithmetic units. The proposed design relaxes previously-imposed constraints on input bit streams-low correlation and long stream lengthand achieves superior area and energy efficiency over existing unary systems. Furthermore, uGEMM's output bit streams exhibit higher accuracy and faster convergence, enabling dynamic energy-accuracy scaling on resource-constrained systems.
引用
收藏
页码:377 / 390
页数:14
相关论文
共 50 条
  • [1] uGEMM: Unary Computing for GEMM Applications
    Wu, Di
    Li, Jingjie
    Yin, Ruokai
    Kim, Younghyun
    San Miguel, Joshua
    Hsiao, Hsuan
    [J]. IEEE MICRO, 2021, 41 (03) : 50 - 56
  • [2] tuGEMM: Area-Power-Efficient Temporal Unary GEMM Architecture for Low-Precision Edge AI
    Nair, Harideep
    Vellaisamy, Prabhu
    Chen, Albert
    Finn, Joseph
    Li, Anna
    Trivedi, Manav
    Shen, John Paul
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [3] Unary Positional Computing
    van der Hagen, McKenzie
    Riedel, Marc
    [J]. 2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 1335 - 1339
  • [4] Cambricon-U: A Systolic Random Increment Memory Architecture for Unary Computing
    Guo, Hongrui
    Zhao, Yongwei
    Li, Zhangmai
    Hao, Yifan
    Liu, Chang
    Song, Xinkai
    Li, Xiaqing
    Du, Zidong
    Zhang, Rui
    Guo, Qi
    Chen, Tianshi
    Xu, Zhiwei
    [J]. 56TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, MICRO 2023, 2023, : 424 - 437
  • [5] An Autonomic Computing Architecture for Business Applications
    Kurian, Devasia
    Chelliah, Pethuru Raj
    [J]. PROCEEDINGS OF THE 2012 WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES, 2012, : 442 - 447
  • [6] Computing explanations for the unary resource constraint
    Vilím, P
    [J]. INTEGRATION OF AI AND OR TECHNIQUES IN CONSTRAINT PROGRAMMING FOR COMBINATORIAL OPTIMIZATION PROBLEMS, 2005, 3524 : 396 - 409
  • [7] Approximate Hybrid Binary-Unary Computing with Applications in BERT Language Model and Image Processing
    Khataei, Alireza
    Singh, Gaurav
    Bazargan, Kia
    [J]. PROCEEDINGS OF THE 2023 ACM/SIGDA INTERNATIONAL SYMPOSIUM ON FIELD PROGRAMMABLE GATE ARRAYS, FPGA 2023, 2023, : 165 - 175
  • [8] Dynamic Reconfigurable Computing Architecture for Aerospace Applications
    LaMeres, Brock J.
    Gauer, Clint
    [J]. 2009 IEEE AEROSPACE CONFERENCE, VOLS 1-7, 2009, : 2091 - 2096
  • [9] A multilevel computing architecture for embedded multimedia applications
    Karim, F
    Mellan, AN
    Nguyen, A
    Aydonat, U
    Abdelrahman, T
    [J]. IEEE MICRO, 2004, 24 (03) : 56 - 66
  • [10] CLOUD COMPUTING Fundamental Architecture & Future Applications
    Leymann, Frank
    [J]. WINSYS 2009: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON WIRELESS INFORMATION NETWORKS AND SYSTEMS, 2009, : IS31 - IS31