PIQARD System for Experimenting and Testing Language Models with Prompting Strategies

被引:0
|
作者
Korcz, Marcin [1 ]
Plaskowski, Dawid [1 ]
Politycki, Mateusz [1 ]
Stefanowski, Jerzy [1 ]
Terentowicz, Alex [1 ]
机构
[1] Poznan Univ Tech, Inst Comp Sci, Poznan, Poland
关键词
Large language models; Prompting; Information retrieval;
D O I
10.1007/978-3-031-43430-3_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs) have seen a surge in popularity due to their impressive results in natural language processing tasks, but there are still challenges to be addressed. Prompting in the question is a solution for some of them. In this paper, we present PIQARD, an open-source Python library that allows researchers to experiment with prompting techniques and information retrieval, and combine them with LLMs. This library includes pre-implemented components and also allows users to integrate their own methods.
引用
收藏
页码:320 / 323
页数:4
相关论文
共 50 条
  • [1] Considerations for Prompting Large Language Models
    Schulte, Brian
    JAMA ONCOLOGY, 2024, 10 (04) : 538 - 538
  • [2] Prompting Language Models for Linguistic Structure
    Blevins, Terra
    Gonen, Hila
    Zettlemoyer, Luke
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 6649 - 6663
  • [3] Prompting Is Programming: A Query Language for Large Language Models
    Beurer-Kellner, Luca
    Fischer, Marc
    Vechev, Martin
    PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL, 2023, 7 (PLDI):
  • [4] Graph Neural Prompting with Large Language Models
    Tian, Yijun
    Song, Huan
    Wang, Zichen
    Wang, Haozhu
    Hu, Ziqing
    Wang, Fang
    Chawla, Nitesh V.
    Xu, Panpan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19080 - 19088
  • [5] Prompting Large Language Models With the Socratic Method
    Chang, Edward Y.
    2023 IEEE 13TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE, CCWC, 2023, : 351 - 360
  • [6] Prompting Large Language Models to Power Educational Chatbots
    Farah, Juan Carlos
    Ingram, Sandy
    Spaenlehauer, Basile
    Lasne, Fanny Kim-Lan
    Gillet, Denis
    ADVANCES IN WEB-BASED LEARNING, ICWL 2023, 2023, 14409 : 169 - 188
  • [7] DDPrompt: Differential Diversity Prompting in Large Language Models
    Mu, Lin
    Zhang, Wenhan
    Zhang, Yiwen
    Jin, Peiquan
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2: SHORT PAPERS, 2024, : 168 - 174
  • [8] Editing Graph Visualizations by Prompting Large Language Models
    Argyriou, Evmorfia
    Boehm, Jens
    Eberle, Anne
    Gonser, Julius
    Lumpp, Anna-Lena
    Niedermann, Benjamin
    Schwarzkopf, Fabian
    GRAPH DRAWING AND NETWORK VISUALIZATION, GD 2023, PT II, 2023, 14466 : 253 - 254
  • [9] Experimenting with a question answering system for the Arabic language
    Hammo, B
    Abuleil, S
    Lytinen, S
    Evens, M
    COMPUTERS AND THE HUMANITIES, 2004, 38 (04): : 397 - 415
  • [10] Considerations for Prompting Large Language Models-Reply
    Chen, Shan
    Savova, Guergana K.
    Bitterman, Danielle S.
    JAMA ONCOLOGY, 2024, 10 (04) : 538 - 539