Learning with Dynamic Architectures for Artificial Neural Networks - Adaptive Batch Size Approach

被引:0
|
作者
Saeed, Reham [1 ]
Ghnemat, Rawan [1 ]
Benbrahim, Ghassen [2 ]
Elhassan, Ammar [1 ]
机构
[1] Princess Sumaya Univ Technol, King Hussein Sch Comp Sci, Amman, Jordan
[2] Prince Mohammad bin Fahd Univ, Coll Comp Engn & Sci, Khobar, Saudi Arabia
来源
2019 2ND INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS) | 2019年
关键词
Artificial Neural Networks; Convolutional Neural Networks; Batch Size; Convergence; Accuracy; Training; Feed-forward; Two-Layer Feed-Forward Net; Sampling; Tensorflow; ADANet; Stochasticity; DESIGN;
D O I
10.1109/ictcs.2019.8923070
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this research we explore the performance of ADANET framework by using custom search space for an image-classification dataset using tensorflow libraries in combination with adaptive batch sizes for learning. In one experiment we classified fashion MNISET data and MNIST data of handwritten digits and obtained favorable results in terms of training time as well as accuracy by alternating learning batch sizes dynamically. Our testing was applied using simple deep neural network (DNN) and also with convolutional neural network (CNN).
引用
收藏
页码:302 / 305
页数:4
相关论文
共 50 条
  • [31] Adaptive Natural Gradient Method for Learning of Stochastic Neural Networks in Mini-Batch Mode
    Park, Hyeyoung
    Lee, Kwanyong
    APPLIED SCIENCES-BASEL, 2019, 9 (21):
  • [32] Complexity of learning in artificial neural networks
    Engel, A
    THEORETICAL COMPUTER SCIENCE, 2001, 265 (1-2) : 285 - 306
  • [33] Artificial neural networks and deep learning
    Geubbelmans, Melvin
    Rousseau, Axel-Jan
    Burzykowski, Tomasz
    Valkenborg, Dirk
    AMERICAN JOURNAL OF ORTHODONTICS AND DENTOFACIAL ORTHOPEDICS, 2024, 165 (02) : 248 - 251
  • [34] Lifelong Learning in Artificial Neural Networks
    Anthes, Gary
    COMMUNICATIONS OF THE ACM, 2019, 62 (06) : 13 - 15
  • [35] PSO Learning on Artificial Neural Networks
    Haridas, Nisha
    Devi, Nirmala M.
    PROCEEDINGS OF THE FIRST AMRITA ACM-W CELEBRATION OF WOMEN IN COMPUTING IN INDIA (A2WIC), 2010,
  • [36] Prediction of pedestrian dynamics in complex architectures with artificial neural networks
    Tordeux, Antoine
    Chraibi, Mohcine
    Seyfried, Armin
    Schadschneider, Andreas
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 24 (06) : 556 - 568
  • [37] Architectures for nanoelectronic implementation of artificial neural networks:: new results
    Türel, Ö
    Lee, JH
    Ma, XL
    Likharev, KK
    NEUROCOMPUTING, 2005, 64 : 271 - 283
  • [38] On Speaker Adaptive Training of Artificial Neural Networks
    Trmal, Jan
    Zelinka, Jan
    Mueller, Ludek
    11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2, 2010, : 554 - 557
  • [39] Adaptive basis function for artificial neural networks
    Philip, NS
    Joseph, KB
    NEUROCOMPUTING, 2002, 47 : 21 - 34
  • [40] Adaptive convolution kernel for artificial neural networks?
    Tek, F. Boray
    Cam, Ilker
    Karli, Deniz
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75 (75)