On the rate of convergence of image classifiers based on convolutional neural networks

被引:7
|
作者
Kohler, Michael [1 ]
Krzyzak, Adam [2 ]
Walter, Benjamin [1 ]
机构
[1] Tech Univ Darmstadt, Fachbereich Math, Schlossgartenstr 7, D-64289 Darmstadt, Germany
[2] Concordia Univ, Dept Comp Sci & Software Engn, 1455 Maisonneuve Blvd West, Montreal, PQ H3G 1M8, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Curse of dimensionality; Convolutional neural networks; Image classification; Rate of convergence;
D O I
10.1007/s10463-022-00828-4
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Image classifiers based on convolutional neural networks are defined, and the rate of convergence of the misclassification risk of the estimates towards the optimal misclassification risk is analyzed. Under suitable assumptions on the smoothness and structure of a posteriori probability, the rate of convergence is shown which is independent of the dimension of the image. This proves that in image classification, it is possible to circumvent the curse of dimensionality by convolutional neural networks. Furthermore, the obtained result gives an indication why convolutional neural networks are able to outperform the standard feedforward neural networks in image classification. Our classifiers are compared with various other classification methods using simulated data. Furthermore, the performance of our estimates is also tested on real images.
引用
收藏
页码:1085 / 1108
页数:24
相关论文
共 50 条
  • [1] On the rate of convergence of image classifiers based on convolutional neural networks
    Michael Kohler
    Adam Krzyżak
    Benjamin Walter
    Annals of the Institute of Statistical Mathematics, 2022, 74 : 1085 - 1108
  • [2] Classifiers Comparison for Convolutional Neural Networks (CNNs) in Image Classification
    Tropea, Mauro
    Fedele, Giuseppe
    2019 IEEE/ACM 23RD INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS (DS-RT), 2019, : 310 - 313
  • [3] Variational convolutional neural networks classifiers
    Huang, Fangyu
    Tan, Xiaoqing
    Huang, Rui
    Xu, Qingshan
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2022, 605
  • [4] Selective convolutional neural networks and cascade classifiers for remote sensing image classification
    Wan, Lihong
    Liu, Na
    Huo, Hong
    Fang, Tao
    REMOTE SENSING LETTERS, 2017, 8 (10) : 917 - 926
  • [5] Convergence of deep convolutional neural networks
    Xu, Yuesheng
    Zhang, Haizhang
    NEURAL NETWORKS, 2022, 153 : 553 - 563
  • [6] Content Based Image Retrieval by Convolutional Neural Networks
    Hamreras, Safa
    Benitez-Rochel, Rafaela
    Boucheham, Bachir
    Molina-Cabello, Miguel A.
    Lopez-Rubio, Ezequiel
    FROM BIOINSPIRED SYSTEMS AND BIOMEDICAL APPLICATIONS TO MACHINE LEARNING, PT II, 2019, 11487 : 277 - 286
  • [7] Image Copy Detection Based on Convolutional Neural Networks
    Zhang, Jing
    Zhu, Wenting
    Li, Bing
    Hu, Weiming
    Yang, Jinfeng
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 111 - 121
  • [8] Image Steganalysis based on Pretrained Convolutional Neural Networks
    Ahmed, Ismail Taha
    Hammad, Baraa Tareq
    Jamil, Norziana
    2022 IEEE 18TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & APPLICATIONS (CSPA 2022), 2022, : 283 - 286
  • [9] Convolutional Neural Networks based Pornographic Image Classification
    Zhou, KaiLong
    Zhou, Li
    Geng, Zhen
    Zhang, Jing
    Li, Xiao Guang
    2016 IEEE SECOND INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2016, : 206 - 209
  • [10] Digital image correlation based on convolutional neural networks
    Duan, Xiaocen
    Xu, Hongwei
    Dong, Runfeng
    Lin, Feng
    Huang, Jianyong
    OPTICS AND LASERS IN ENGINEERING, 2023, 160