Forward stagewise regression with multilevel memristor for sparse coding

被引:3
|
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [11] Defect Consideratons for Robust Sparse Coding Using Memristor Arrays
    Sheridan, Patrick
    Lu, Wei D.
    PROCEEDINGS OF THE 2015 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH 15), 2015, : 137 - 138
  • [12] Multilevel Coding Schemes for Compute-and-Forward
    Hern, Brett
    Narayanan, Krishna
    2011 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2011, : 1713 - 1717
  • [13] Compress-and-Forward via Multilevel Coding
    Wan, Heping
    Host-Madsen, Anders
    Nosratinia, Aria
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 2024 - 2028
  • [14] Forward stagewise naive Bayes
    Vidaurre, Diego
    Bielza, Concha
    Larranaga, Pedro
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (01) : 57 - 69
  • [15] Sparse Regression of Power Amplifier Behavioral Models with a Stagewise Doubly Orthogonal Matching Pursuit
    Becerra, Juan A.
    Nogales, Miguel
    Marques-Valderrama, Elias
    Madero-Ayora, Maria J.
    2023 IEEE TOPICAL CONFERENCE ON RF/MICROWAVE POWER AMPLIFIERS FOR RADIO AND WIRELESS APPLICATIONS, 2023, : 22 - 25
  • [16] ESTIMATING THE VARIANCE IN STAGEWISE REGRESSION
    CHRISTENSEN, R
    AMERICAN STATISTICIAN, 1988, 42 (04): : 288 - 288
  • [17] Smooth sparse coding via marginal regression for learning sparse representations
    Balasubramanian, Krishnakumar
    Yu, Kai
    Lebanon, Guy
    ARTIFICIAL INTELLIGENCE, 2016, 238 : 83 - 95
  • [18] Regression with stagewise minimization on risk function
    Yoshida, Takuma
    Naito, Kanta
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 134 : 123 - 143
  • [19] Multilevel Coding Schemes for Compute-and-Forward With Flexible Decoding
    Hern, Brett
    Narayanan, Krishna R.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (11) : 7613 - 7631
  • [20] An orthogonal forward regression technique for sparse kernel density estimation
    Chen, S.
    Hong, X.
    Harris, C. J.
    NEUROCOMPUTING, 2008, 71 (4-6) : 931 - 943