Novel applications of Convolutional Neural Networks in the age of Transformers

被引:1
|
作者
Ersavas, Tansel [1 ]
Smith, Martin A. [1 ,2 ,3 ,4 ]
Mattick, John S. [1 ]
机构
[1] UNSW Sydney, Sch Biotechnol & Biomol Sci, Sydney, NSW 2052, Australia
[2] Univ Montreal, Fac Med, Dept Biochem & Mol Med, Montreal, PQ H3C 3J7, Canada
[3] CHU Sainte Justine Res Ctr, Montreal, PQ, Canada
[4] UNSW Sydney, UNSW RNA Inst, Sydney, Australia
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
IMAGE;
D O I
10.1038/s41598-024-60709-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Convolutional Neural Networks (CNNs) have been central to the Deep Learning revolution and played a key role in initiating the new age of Artificial Intelligence. However, in recent years newer architectures such as Transformers have dominated both research and practical applications. While CNNs still play critical roles in many of the newer developments such as Generative AI, they are far from being thoroughly understood and utilised to their full potential. Here we show that CNNs can recognise patterns in images with scattered pixels and can be used to analyse complex datasets by transforming them into pseudo images with minimal processing for any high dimensional dataset, representing a more general approach to the application of CNNs to datasets such as in molecular biology, text, and speech. We introduce a pipeline called DeepMapper, which allows analysis of very high dimensional datasets without intermediate filtering and dimension reduction, thus preserving the full texture of the data, enabling detection of small variations normally deemed 'noise'. We demonstrate that DeepMapper can identify very small perturbations in large datasets with mostly random variables, and that it is superior in speed and on par in accuracy to prior work in processing large datasets with large numbers of features.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Convolutional Neural Networks for Classifying Electronic Components in Industrial Applications
    Hozyn, Stanislaw
    [J]. ENERGIES, 2023, 16 (02)
  • [42] Deep convolutional neural networks for mammography: advances, challenges and applications
    Dina Abdelhafiz
    Clifford Yang
    Reda Ammar
    Sheida Nabavi
    [J]. BMC Bioinformatics, 20
  • [43] 1D convolutional neural networks and applications: A survey
    Kiranyaz, Serkan
    Avci, Onur
    Abdeljaber, Osama
    Ince, Turker
    Gabbouj, Moncef
    Inman, Daniel J.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 151
  • [44] Applications of convolutional neural networks in education: A systematic literature review
    Silva, Lenardo Chaves e
    Sobrinho, Alvaro Alvares de Carvalho Cesar
    Cordeiro, Thiago Damasceno
    Melo, Rafael Ferreira
    Bittencourt, Ig Ibert
    Marques, Leonardo Brandao
    Matos, Diego Dermeval Medeiros da Cunha
    da Silva, Alan Pedro
    Isotani, Seiji
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [45] Role of Convolutional Neural Networks in Hyperspectral Imaging Applications: A Review
    Lanke, Neha P.
    Chandak, M. B.
    [J]. FOURTH CONGRESS ON INTELLIGENT SYSTEMS, VOL 2, CIS 2023, 2024, 869 : 201 - 207
  • [46] Spatial Footstep Recognition by Convolutional Neural Networks for Biometric Applications
    Costilla-Reyes, Omar
    Vera-Rodriguez, Ruben
    Scully, Patricia
    Ozanyan, Krikor B.
    [J]. 2016 IEEE SENSORS, 2016,
  • [47] Merging and Evolution: Improving Convolutional Neural Networks for Mobile Applications
    Qin, Zheng
    Zhang, Zhaoning
    Zhang, Shiqing
    Yu, Hao
    Li, Jincai
    Peng, Yuxing
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [48] Learning of Recurrent Convolutional Neural Networks with Applications in Pattern Recognition
    Wang, Qiaoyun
    Huang, He
    [J]. PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 4135 - 4139
  • [49] Deep convolutional neural networks for mammography: advances, challenges and applications
    Abdelhafiz, Dina
    Yang, Clifford
    Ammar, Reda
    Nabavi, Sheida
    [J]. BMC BIOINFORMATICS, 2019, 20 (Suppl 11)
  • [50] Applications and Comparisons of Optimization Algorithms Used in Convolutional Neural Networks
    Seyyarer, Ebubekir
    Uckan, Taner
    Hark, Cengiz
    Ayata, Faruk
    Inan, Mevlut
    Karci, Ali
    [J]. 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA PROCESSING (IDAP 2019), 2019,