Learning with Dynamic Architectures for Artificial Neural Networks - Adaptive Batch Size Approach

被引:0
|
作者
Saeed, Reham [1 ]
Ghnemat, Rawan [1 ]
Benbrahim, Ghassen [2 ]
Elhassan, Ammar [1 ]
机构
[1] Princess Sumaya Univ Technol, King Hussein Sch Comp Sci, Amman, Jordan
[2] Prince Mohammad bin Fahd Univ, Coll Comp Engn & Sci, Khobar, Saudi Arabia
来源
2019 2ND INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS) | 2019年
关键词
Artificial Neural Networks; Convolutional Neural Networks; Batch Size; Convergence; Accuracy; Training; Feed-forward; Two-Layer Feed-Forward Net; Sampling; Tensorflow; ADANet; Stochasticity; DESIGN;
D O I
10.1109/ictcs.2019.8923070
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this research we explore the performance of ADANET framework by using custom search space for an image-classification dataset using tensorflow libraries in combination with adaptive batch sizes for learning. In one experiment we classified fashion MNISET data and MNIST data of handwritten digits and obtained favorable results in terms of training time as well as accuracy by alternating learning batch sizes dynamically. Our testing was applied using simple deep neural network (DNN) and also with convolutional neural network (CNN).
引用
收藏
页码:302 / 305
页数:4
相关论文
共 50 条
  • [1] Parallel Architectures for Learning the RTRN and Elman Dynamic Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (09) : 2561 - 2570
  • [2] A review of adaptive online learning for artificial neural networks
    Beatriz Pérez-Sánchez
    Oscar Fontenla-Romero
    Bertha Guijarro-Berdiñas
    Artificial Intelligence Review, 2018, 49 : 281 - 299
  • [3] A review of adaptive online learning for artificial neural networks
    Perez-Sanchez, Beatriz
    Fontenla-Romero, Oscar
    Guijarro-Berdinas, Bertha
    ARTIFICIAL INTELLIGENCE REVIEW, 2018, 49 (02) : 281 - 299
  • [4] AdaNet: Adaptive Structural Learning of Artificial Neural Networks
    Cortes, Corinna
    Gonzalvo, Xavier
    Kuznetsov, Vitaly
    Mohri, Mehryar
    Yang, Scott
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [5] ULSI architectures for artificial neural networks
    Rückert, U
    NINTH EUROMICRO WORKSHOP ON PARALLEL AND DISTRIBUTED PROCESSING, PROCEEDINGS, 2001, : 436 - 442
  • [6] ULSI architectures for artificial neural networks
    Rückert, U
    IEEE MICRO, 2002, 22 (03) : 10 - 19
  • [7] Machine Learning Approach for Degradation Path Prediction Using Different Models and Architectures of Artificial Neural Networks
    Shaheen, Basheer
    Nemeth, Istvan
    PERIODICA POLYTECHNICA-MECHANICAL ENGINEERING, 2022, 66 (03): : 244 - 252
  • [8] Dynamic Changes of Population Size in Training of Artificial Neural Networks
    Slowik, A.
    Bialko, M.
    HUMAN-COMPUTER SYSTEMS INTERACTION: BACKGROUNDS AND APPLICATIONS, 2009, 60 : 517 - 527
  • [9] ALEC: An adaptive learning framework for optimizing artificial neural networks
    Abraham, A
    Nath, B
    COMPUTATIONAL SCIENCE -- ICCS 2001, PROCEEDINGS PT 2, 2001, 2074 : 171 - 180
  • [10] Simulating artificial neural networks on parallel architectures
    Serbedzija, NB
    COMPUTER, 1996, 29 (03) : 56 - &