Improving performance of convolutional neural networks using adaptive morlet wavelet filters

被引:0
|
作者
Rezazadeh, Nader [1 ]
Mirzarezaee, Mitra [1 ]
Sharifi, Arash [1 ]
Manthouri, Mohammad [2 ]
机构
[1] Islamic Azad Univ, Dept Comp Engn, Sci & Res Branch, Tehran, Iran
[2] Shahed Univ, Dept Elect & Elect Engn, Tehran, Iran
关键词
CNNs; Pixel-based kernels; Adaptive kernels; Morlet wavelet; Volterra convolution; Nonlinearization; RECEPTIVE-FIELDS;
D O I
10.1007/s13748-024-00354-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, the proliferation of Convolutional Neural Network (CNN) variables is a direct result of the exigency for meticulous image analysis and classification. In the realm of traditional CNN architecture, the sole means of discerning nonlinear patterns resided in the utilization of the pooling layer and the activation function. Therefore, CNNs must augment the count of convolutions and pooling layers. Additionally, every kernel employs constant coefficients, enabling it to approximate just one pattern within the input image. Given the escalating intricacy and growing diversity of patterns, it becomes imperative to increase the number of filters and consequently, augment the count of CNN variables. The focus of this study is to incorporate Morlet wavelet functions into the kernels, aiming to bolster their capability to perceive and extract intricate patterns. Given the employment of non-constant coefficients in the suggested kernels, the coefficients within the kernel adjust proportionally to the input. Consequently, this amplifies the spectrum of diverse patterns that the kernel discerns within the image. Moreover, the effectiveness of the functions and the methodology implemented in the proposed Kernel holds the potential to substantially curtail computational expenditures, stemming from the utilization of Morlet kernels with non-constant coefficients. The proposed method proposes a significant reduction in the count of trainable parameters, marking a decrease of 98% in comparison to the conventional structure and an 83% decrease when contrasted with the Volterra convolutional method.
引用
收藏
页码:75 / 100
页数:26
相关论文
共 50 条
  • [41] Deterministic Binary Filters for Convolutional Neural Networks
    Tseng, Vincent W-S
    Bhattachara, Sourav
    Fernandez-Marques, Javier
    Alizadeh, Milad
    Tong, Catherine
    Lane, Nicholas D.
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2739 - 2747
  • [42] Learning the number of filters in convolutional neural networks
    Li, Jue
    Cao, Feng
    Cheng, Honghong
    Qian, Yuhua
    INTERNATIONAL JOURNAL OF BIO-INSPIRED COMPUTATION, 2021, 17 (02) : 75 - 84
  • [43] Convolutional Filters and Neural Networks With Noncommutative Algebras
    Parada-Mayorga, Alejandro
    Butler, Landon
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 2683 - 2698
  • [44] Graph Neural Networks With Convolutional ARMA Filters
    Bianchi, Filippo Maria
    Grattarola, Daniele
    Livi, Lorenzo
    Alippi, Cesare
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3496 - 3507
  • [45] Initialization of Convolutional Neural Networks by Gabor Filters
    Ozbulak, Gokhan
    Ekenel, Hazim Kemal
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [46] Hyperspectral imaging classification based on convolutional neural networks by adaptive sizes of windows and filters
    Hamouda, Maissa
    Ettabaa, Karim Saheb
    Bouhlel, Med Salim
    IET IMAGE PROCESSING, 2019, 13 (02) : 392 - 398
  • [47] MIMO Graph Filters for Convolutional Neural Networks
    Gama, Fernando
    Marques, Antonio G.
    Ribeiro, Alejandro
    Leus, Geert
    2018 IEEE 19TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2018, : 651 - 655
  • [48] Improving wavelet compression with neural networks
    Burges, CJC
    Simard, PY
    Malvar, HS
    DCC 2001: DATA COMPRESSION CONFERENCE, PROCEEDINGS, 2001, : 486 - 486
  • [49] Time Series Decomposition for Improving the Forecasting Performance of Convolutional Neural Networks
    Mendez-Jimenez, Ivan
    Cardenas-Montes, Miguel
    ADVANCES IN ARTIFICIAL INTELLIGENCE, CAEPIA 2018, 2018, 11160 : 87 - 97
  • [50] Improving the statistical downscaling performance of climatic parameters with convolutional neural networks
    Baghanam, Aida Hosseini
    Nourani, Vahid
    Bejani, Mohammad
    Ke, Chang-Qing
    JOURNAL OF WATER AND CLIMATE CHANGE, 2024, 15 (04) : 1772 - 1796