Survey of transformers and towards ensemble learning using transformers for natural language processing

被引:0
|
作者
Hongzhi Zhang
M. Omair Shafiq
机构
[1] Carleton University,School of Information Technology
来源
关键词
Transformer model; Natural language tasks; Transformer-based model; Ensemble learning;
D O I
暂无
中图分类号
学科分类号
摘要
引用
收藏
相关论文
共 50 条
  • [41] Semantic segmentation using Vision Transformers: A survey
    Thisanke, Hans
    Deshan, Chamli
    Chamith, Kavindu
    Seneviratne, Sachith
    Vidanaarachchi, Rajith
    Herath, Damayanthi
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [42] A comprehensive survey on applications of transformers for deep learning tasks
    Islam, Saidul
    Elmekki, Hanae
    Elsebai, Ahmed
    Bentahar, Jamal
    Drawel, Nagat
    Rjoub, Gaith
    Pedrycz, Witold
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 241
  • [43] Towards Emotion Cause Generation in Natural Language Processing using Deep Learning
    Riyadh, Md
    Shafiq, M. Omair
    [J]. 2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 140 - 147
  • [44] A Survey of the Usages of Deep Learning for Natural Language Processing
    Otter, Daniel W.
    Medina, Julian R.
    Kalita, Jugal K.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 604 - 624
  • [45] A novel physical activity recognition approach using deep ensemble optimized transformers and reinforcement learning
    Ahmadian, Sajad
    Rostami, Mehrdad
    Farrahi, Vahid
    Oussalah, Mourad
    [J]. NEURAL NETWORKS, 2024, 173
  • [46] Neural Text Categorization with Transformers for Learning Portuguese as a Second Language
    Santos, Rodrigo
    Rodrigues, Joao
    Branco, Antonio
    Vaz, Rui
    [J]. PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2021), 2021, 12981 : 715 - 726
  • [47] Transformers based Python']Python Code Generation from Natural Language
    Swathi, Smt E.
    Vanga, Abhinav Reddy
    [J]. 2024 5TH INTERNATIONAL CONFERENCE ON INNOVATIVE TRENDS IN INFORMATION TECHNOLOGY, ICITIIT 2024, 2024,
  • [48] Applying Deep Learning and Natural Language Processing in Cancer: A Survey
    AbuSamra, Aiman Ahmad
    Al-Madhoun, Areej M. R.
    [J]. 2021 PALESTINIAN INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (PICICT 2021), 2021, : 103 - 115
  • [49] Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability
    Richardson, Kyle
    Sabharwal, Ashish
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11209 - 11219
  • [50] Factorization-Aware Training of Transformers for Natural Language Understanding On the Edge
    Saghir, Hamidreza
    Choudhary, Samridhi
    Eghbali, Sepehr
    Chung, Clement
    [J]. INTERSPEECH 2021, 2021, : 4733 - 4737