Forward stagewise regression with multilevel memristor for sparse coding

被引:3
|
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] A note on coding and standardization of categorical variables in (sparse) group lasso regression
    Detmer, Felicitas J.
    Cebral, Juan
    Slawski, Martin
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2020, 206 : 1 - 11
  • [32] Sparse Regression Codes for Multi-terminal Source and Channel Coding
    Venkataramanan, Ramji
    Tatikonda, Sekhar
    2012 50TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2012, : 1966 - 1974
  • [33] A MULTILEVEL FRAMEWORK FOR SPARSE OPTIMIZATION WITH APPLICATION TO INVERSE COVARIANCE ESTIMATION AND LOGISTIC REGRESSION
    Treister, Eran
    Turek, Javier S.
    Yavneh, Irad
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2016, 38 (05): : S566 - S592
  • [34] Fused stagewise regression - A waveband selection algorithm for spectroscopy
    Malli, B.
    Natschlaeger, T.
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2015, 149 : 53 - 65
  • [35] A gradient-based forward greedy algorithm for sparse Gaussian process regression
    Sun, Ping
    Yao, Xin
    TRENDS IN NEURAL COMPUTATION, 2007, 35 : 241 - +
  • [36] Weighted sparse coding regularized nonconvex matrix regression for robust face recognition
    Zhang, Hengmin
    Yang, Jian
    Xie, Jianchun
    Qian, Jianjun
    Zhang, Bob
    INFORMATION SCIENCES, 2017, 394 : 1 - 17
  • [37] Multilevel Coding for the Full-Duplex Decode-Compress-Forward Relay Channel
    Abotabl, Ahmed Attia
    Nosratinia, Aria
    ENTROPY, 2017, 19 (11)
  • [38] On Superposition Multilevel Coding for the 3-Node Relay Channel Exploiting Decode and Forward
    Kern, Daniel
    Kuehn, Volker
    2015 IEEE 82ND VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2015,
  • [39] Sparse codes from memristor grids
    Bruno A. Olshausen
    Christopher J. Rozell
    Nature Nanotechnology, 2017, 12 : 722 - 723
  • [40] A compression-based backward approach for the forward sparse modeling with application to speech coding
    Omara, A. N.
    Hefnawy, A. A.
    Zekry, Abdelhalim
    COMPUTERS & ELECTRICAL ENGINEERING, 2017, 62 : 612 - 629