Forward stagewise regression with multilevel memristor for sparse coding

被引:3
|
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] A Forward and Backward Stagewise algorithm for nonconvex loss functions with adaptive Lasso
    Shi, Xingjie
    Huang, Yuan
    Huang, Jian
    Ma, Shuangge
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2018, 124 : 235 - 251
  • [42] Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding, and Applications
    Gao, Shenghua
    Tsang, Ivor Wai-Hung
    Chia, Liang-Tien
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) : 92 - 104
  • [43] Stagewise K-SVD to Design Efficient Dictionaries for Sparse Representations
    Rusu, Cristian
    Dumitrescu, Bogdan
    IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (10) : 631 - 634
  • [45] Sparse model identification using a forward orthogonal regression algorithm aided by mutual information
    Billings, Stephen A.
    Wei, Hua-Liang
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2007, 18 (01): : 306 - 310
  • [46] FIRST: Combining forward iterative selection and shrinkage in high dimensional sparse linear regression
    Hwang, Wook Yeon
    Zhang, Hao Helen
    Ghosal, Subhashis
    STATISTICS AND ITS INTERFACE, 2009, 2 (03) : 341 - 348
  • [47] Sparse support vector regression based on orthogonal forward selection for the generalised kernel model
    Wang, X. X.
    Chen, S.
    Lowe, D.
    Harris, C. J.
    NEUROCOMPUTING, 2006, 70 (1-3) : 462 - 474
  • [48] Comparison of l1-Norm SVR and Sparse Coding Algorithms for Linear Regression
    Zhang, Qingtian
    Hu, Xiaolin
    Zhang, Bo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (08) : 1828 - 1833
  • [49] UNIVERSAL IMAGE CODING APPROACH USING SPARSE STEERED MIXTURE-OF-EXPERTS REGRESSION
    Verhack, Ruben
    Sikora, Thomas
    Lange, Lieven
    Van Wallendael, Glenn
    Lambert, Peter
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2142 - 2146
  • [50] Greedy regression in sparse coding space for single-image super-resolution
    Tang, Yi
    Yuan, Yuan
    Yan, Pingkun
    Li, Xuelong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2013, 24 (02) : 148 - 159