Improving performance of convolutional neural networks using adaptive morlet wavelet filters

被引:0
|
作者
Rezazadeh, Nader [1 ]
Mirzarezaee, Mitra [1 ]
Sharifi, Arash [1 ]
Manthouri, Mohammad [2 ]
机构
[1] Islamic Azad Univ, Dept Comp Engn, Sci & Res Branch, Tehran, Iran
[2] Shahed Univ, Dept Elect & Elect Engn, Tehran, Iran
关键词
CNNs; Pixel-based kernels; Adaptive kernels; Morlet wavelet; Volterra convolution; Nonlinearization; RECEPTIVE-FIELDS;
D O I
10.1007/s13748-024-00354-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, the proliferation of Convolutional Neural Network (CNN) variables is a direct result of the exigency for meticulous image analysis and classification. In the realm of traditional CNN architecture, the sole means of discerning nonlinear patterns resided in the utilization of the pooling layer and the activation function. Therefore, CNNs must augment the count of convolutions and pooling layers. Additionally, every kernel employs constant coefficients, enabling it to approximate just one pattern within the input image. Given the escalating intricacy and growing diversity of patterns, it becomes imperative to increase the number of filters and consequently, augment the count of CNN variables. The focus of this study is to incorporate Morlet wavelet functions into the kernels, aiming to bolster their capability to perceive and extract intricate patterns. Given the employment of non-constant coefficients in the suggested kernels, the coefficients within the kernel adjust proportionally to the input. Consequently, this amplifies the spectrum of diverse patterns that the kernel discerns within the image. Moreover, the effectiveness of the functions and the methodology implemented in the proposed Kernel holds the potential to substantially curtail computational expenditures, stemming from the utilization of Morlet kernels with non-constant coefficients. The proposed method proposes a significant reduction in the count of trainable parameters, marking a decrease of 98% in comparison to the conventional structure and an 83% decrease when contrasted with the Volterra convolutional method.
引用
收藏
页码:75 / 100
页数:26
相关论文
共 50 条
  • [1] Improving Performance of Convolutional Neural Networks by Separable Filters on GPU
    Kang, Hao-Ping
    Lee, Che-Rung
    EURO-PAR 2015: PARALLEL PROCESSING, 2015, 9233 : 638 - 649
  • [2] Adaptive filters in Graph Convolutional Neural Networks
    Apicella, Andrea
    Isgro, Francesco
    Pollastro, Andrea
    Prevete, Roberto
    PATTERN RECOGNITION, 2023, 144
  • [3] Adaptive wavelet pooling for convolutional neural networks
    Wolter, Moritz
    Garcke, Jochen
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [4] Image categorization and coding using neural networks and adaptive wavelet filters
    Saha, S
    Vemuri, R
    PROCEEDINGS OF IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY 2000, VOLS 1 AND 2, 2000, : 438 - 443
  • [5] Improving efficiency in convolutional neural networks with multilinear filters
    Dat Thanh Tran
    Iosifidis, Alexandros
    Gabbouj, Moncef
    NEURAL NETWORKS, 2018, 105 : 328 - 339
  • [6] Synthesis of Wavelet Filters using Wavelet Neural Networks
    Bellil, Wajdi
    Ben Amar, Chokri
    Alimi, Adel M.
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 13, 2006, 13 : 108 - 111
  • [7] Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
    Qi, Zhanyuan
    Jung, Cheolkon
    Xie, Binghua
    IEEE ACCESS, 2021, 9 : 62593 - 62601
  • [8] Morlet Wavelet-Based Voice Liveness Detection using Convolutional Neural Network
    Gupta, Priyanka
    Chodingala, Piyushkumar K.
    Patil, Hemant A.
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 100 - 104
  • [9] MORLET WAVELET TRANSFORMS AND NEURAL NETWORKS IN POLYSOMNOGRAPHY ANALYSIS
    Stretch, R.
    Zeidler, M.
    SLEEP, 2020, 43 : A173 - A173
  • [10] Morlet Wavelet chaotic neural networks with random noise
    Xu, Yaoqun
    Sun, Ming
    Guo, Mengshu
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2007, 14 : 661 - 666