Novel applications of Convolutional Neural Networks in the age of Transformers

被引:1
|
作者
Ersavas, Tansel [1 ]
Smith, Martin A. [1 ,2 ,3 ,4 ]
Mattick, John S. [1 ]
机构
[1] UNSW Sydney, Sch Biotechnol & Biomol Sci, Sydney, NSW 2052, Australia
[2] Univ Montreal, Fac Med, Dept Biochem & Mol Med, Montreal, PQ H3C 3J7, Canada
[3] CHU Sainte Justine Res Ctr, Montreal, PQ, Canada
[4] UNSW Sydney, UNSW RNA Inst, Sydney, Australia
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
IMAGE;
D O I
10.1038/s41598-024-60709-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Convolutional Neural Networks (CNNs) have been central to the Deep Learning revolution and played a key role in initiating the new age of Artificial Intelligence. However, in recent years newer architectures such as Transformers have dominated both research and practical applications. While CNNs still play critical roles in many of the newer developments such as Generative AI, they are far from being thoroughly understood and utilised to their full potential. Here we show that CNNs can recognise patterns in images with scattered pixels and can be used to analyse complex datasets by transforming them into pseudo images with minimal processing for any high dimensional dataset, representing a more general approach to the application of CNNs to datasets such as in molecular biology, text, and speech. We introduce a pipeline called DeepMapper, which allows analysis of very high dimensional datasets without intermediate filtering and dimension reduction, thus preserving the full texture of the data, enabling detection of small variations normally deemed 'noise'. We demonstrate that DeepMapper can identify very small perturbations in large datasets with mostly random variables, and that it is superior in speed and on par in accuracy to prior work in processing large datasets with large numbers of features.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Deepfake detection using convolutional vision transformers and convolutional neural networks
    Soudy, Ahmed Hatem
    Sayed, Omnia
    Tag-Elser, Hala
    Ragab, Rewaa
    Mohsen, Sohaila
    Mostafa, Tarek
    Abohany, Amr A.
    Slim, Salwa O.
    [J]. Neural Computing and Applications, 2024, 36 (31) : 19759 - 19775
  • [2] CMT: Convolutional Neural Networks Meet Vision Transformers
    Guo, Jianyuan
    Han, Kai
    Wu, Han
    Tang, Yehui
    Chen, Xinghao
    Wang, Yunhe
    Xu, Chang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12165 - 12175
  • [3] Visualization Comparison of Vision Transformers and Convolutional Neural Networks
    Shi, Rui
    Li, Tianxing
    Zhang, Liguo
    Yamaguchi, Yasushi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2327 - 2339
  • [4] Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation
    Nanni, Loris
    Fantozzi, Carlo
    Loreggia, Andrea
    Lumini, Alessandra
    [J]. SENSORS, 2023, 23 (10)
  • [5] Adversarial Robustness of Vision Transformers Versus Convolutional Neural Networks
    Ali, Kazim
    Bhatti, Muhammad Shahid
    Saeed, Atif
    Athar, Atifa
    Al Ghamdi, Mohammed A.
    Almotiri, Sultan H.
    Akram, Samina
    [J]. IEEE ACCESS, 2024, 12 : 105281 - 105293
  • [6] Do Vision Transformers See Like Convolutional Neural Networks?
    Raghu, Maithra
    Unterthiner, Thomas
    Kornblith, Simon
    Zhang, Chiyuan
    Dosovitskiy, Alexey
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [7] Remote heart rate estimation via convolutional neural networks with transformers
    Guo, Zongheng
    Chen, Huahua
    Lin, Lili
    Zhou, Wenhui
    Yang, Meng
    Ying, Na
    Guo, Chunsheng
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (17): : 13149 - 13165
  • [8] Deepfake Detection with Deep Learning: Convolutional Neural Networks versus Transformers
    Thing, Vrizlynn L. L.
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND RESILIENCE, CSR, 2023, : 246 - 253
  • [9] Dynamic Spatial Sparsification for Efficient Vision Transformers and Convolutional Neural Networks
    Rao, Yongming
    Liu, Zuyan
    Zhao, Wenliang
    Zhou, Jie
    Lu, Jiwen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10883 - 10897
  • [10] Understanding and improving adversarial transferability of vision transformers and convolutional neural networks
    Chen, Zhiyu
    Xu, Chi
    Lv, Huanhuan
    Liu, Shangdong
    Ji, Yimu
    [J]. INFORMATION SCIENCES, 2023, 648