Survey of transformers and towards ensemble learning using transformers for natural language processing

被引：0
|
作者：
Hongzhi Zhang
M. Omair Shafiq
机构：
[1] Carleton University,School of Information Technology
来源：
Journal of Big Data | / 11卷
关键词：
Transformer model; Natural language tasks; Transformer-based model; Ensemble learning;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
相关论文
共 50 条
  • [21] Ensemble Learning using Transformers and Convolutional Networks for Masked Face Recognition
    Al-Sinan, Mohammed R.
    Haneef, Aseel F.
    Lugman, Hamzah
    [J]. 2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS, 2022, : 421 - 426
  • [22] From rule-based models to deep learning transformers architectures for natural language processing and sign language translation systems: survey, taxonomy and performance evaluation
    Shahin, Nada
    Ismail, Leila
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (10)
  • [23] Natural Language Processing Applied to Forensics Information Extraction With Transformers and Graph Visualization
    Barros Rodrigues, Fillipe
    Ferreira Giozza, William
    de Oliveira Albuquerque, Robson
    Garcia Villalba, Luis Javier
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04): : 4727 - 4743
  • [24] The Text-Package: An R-Package for Analyzing and Visualizing Human Language Using Natural Language Processing and Transformers
    Kjell, Oscar
    Giorgi, Salvatore
    Schwartz, H. Andrew
    [J]. PSYCHOLOGICAL METHODS, 2023, 28 (06) : 1478 - 1498
  • [25] An Overview of Vision Transformers for Image Processing: A Survey
    Kameswari, Ch. Sita
    Kavitha, J.
    Reddy, T. Srinivas
    Chinthaguntla, Balaswamy
    Jagatheesaperumal, Senthil Kumar
    Gaftandzhieva, Silvia
    Doneva, Rositsa
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (08) : 273 - 289
  • [26] Topical language generation using transformers
    Zandie, Rohola
    Mahoor, Mohammad H.
    [J]. NATURAL LANGUAGE ENGINEERING, 2023, 29 (02) : 337 - 359
  • [27] Transfer Learning of Transformers for Spoken Language Understanding
    Svec, Jan
    Fremund, Adam
    Bulin, Martin
    Lehecka, Jan
    [J]. TEXT, SPEECH, AND DIALOGUE (TSD 2022), 2022, 13502 : 489 - 500
  • [28] On the Validity of Pre-Trained Transformers for Natural Language Processing in the Software Engineering Domain
    von der Mosel, Julian
    Trautsch, Alexander
    Herbold, Steffen
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2023, 49 (04) : 1487 - 1507
  • [29] Network Intrusion Detection using Natural Language Processing and Ensemble Machine Learning
    Das, Saikat
    Ashrafuzzamant, Mohammad
    Sheldon, Frederick T.
    Shiva, Sajjan
    [J]. 2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 829 - 835
  • [30] Towards Learning Universal Hyperparameter Optimizers with Transformers
    Chen, Yutian
    Song, Xingyou
    Lee, Chansoo
    Wang, Zi
    Zhang, Qiuyi
    Dohan, David
    Kawakami, Kazuya
    Kochanski, Greg
    Doucet, Arnaud
    Ranzato, Marc'aurelio
    Perel, Sagi
    de Freitas, Nando
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
12345