Forward stagewise regression with multilevel memristor for sparse coding

被引:3
|
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Greedy forward selection algorithms to sparse Gaussian process regression
    Sun, Ping
    Yao, Xin
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 159 - +
  • [22] Iterative decoding for sparse sequence LDPC-coded multilevel coding
    Huang, Ping
    He, Shanbao
    Zhao, Chunming
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2006, 36 (02): : 194 - 197
  • [23] Regression-based Sparse Coding for Facial Point Detection
    Tan, Shuqiu
    Guo, Chenggang
    Chen, Dongyi
    Huang, Zhiqi
    2016 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2016), 2016, : 179 - 182
  • [24] Secure Coding for the Gaussian Wiretap Channel with Sparse Regression Codes
    Athanasakos, Manos
    2021 55TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2021,
  • [25] Compress-and-Forward Via Multilevel Coding and Trellis Coded Quantization
    Wan, Heping
    Host-Madsen, Anders
    Nosratinia, Aria
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (04) : 1163 - 1167
  • [26] Forward-stagewise clustering: An algorithm for convex clustering
    Zhang, Mimi
    PATTERN RECOGNITION LETTERS, 2019, 128 : 283 - 289
  • [27] Sparse mzodeling using orthogonal forward regression with PRESS statistic and regularization
    Chen, S
    Hong, X
    Harris, CJ
    Sharkey, PM
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02): : 898 - 911
  • [28] A forward-constrained regression algorithm for sparse kernel density estimation
    Hong, Xia
    Chen, Sheng
    Harris, Chris J.
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (01): : 193 - 198
  • [29] A sparse kernel density estimation algorithm using forward constrained regression
    Hong, Xia
    Chen, Sheng
    Harris, Chris
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS: WITH ASPECTS OF CONTEMPORARY INTELLIGENT COMPUTING TECHNIQUES, 2007, 2 : 1354 - +
  • [30] Forward Stagewise Additive Model for Collaborative Multiview Boosting
    Lahiri, Avisek
    Paria, Biswajit
    Biswas, Prabir Kumar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (02) : 470 - 485