PIQARD System for Experimenting and Testing Language Models with Prompting Strategies

被引:0
|
作者
Korcz, Marcin [1 ]
Plaskowski, Dawid [1 ]
Politycki, Mateusz [1 ]
Stefanowski, Jerzy [1 ]
Terentowicz, Alex [1 ]
机构
[1] Poznan Univ Tech, Inst Comp Sci, Poznan, Poland
关键词
Large language models; Prompting; Information retrieval;
D O I
10.1007/978-3-031-43430-3_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs) have seen a surge in popularity due to their impressive results in natural language processing tasks, but there are still challenges to be addressed. Prompting in the question is a solution for some of them. In this paper, we present PIQARD, an open-source Python library that allows researchers to experiment with prompting techniques and information retrieval, and combine them with LLMs. This library includes pre-implemented components and also allows users to integrate their own methods.
引用
收藏
页码:320 / 323
页数:4
相关论文
共 50 条
  • [41] A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models
    Song, Yuan-Feng
    He, Yuan-Qin
    Zhao, Xue-Fang
    Gu, Han-Lin
    Jiang, Di
    Yang, Hai-Jun
    Fan, Li-Xin
    Journal of Computer Science and Technology, 2024, 39 (04) : 984 - 1004
  • [42] PromptSMILES: prompting for scaffold decoration and fragment linking in chemical language models
    Thomas, Morgan
    Ahmad, Mazen
    Tresadern, Gary
    de Fabritiis, Gianni
    JOURNAL OF CHEMINFORMATICS, 2024, 16 (01):
  • [43] Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Prediction
    Jiang, Cong
    Yang, Xiaolei
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND LAW, ICAIL 2023, 2023, : 417 - 421
  • [44] Prompting Vision-Language Models for Dental Notation Aware Abnormality Detection
    Du, Chenlin
    Chen, Xiaoxuan
    Wang, Jingyi
    Wang, Junjie
    Li, Zhongsen
    Zhang, Zongjiu
    Lao, Qicheng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XII, 2024, 15012 : 687 - 697
  • [45] Software System Testing Assisted by Large Language Models: An Exploratory Study
    Augusto, Cristian
    Moran, Jesus
    Bertolino, Antonia
    de la Riva, Claudio
    Tuya, Javier
    TESTING SOFTWARE AND SYSTEMS, ICTSS 2024, 2025, 15383 : 239 - 255
  • [46] Who Wrote it and Why? Prompting Large-Language Models for Authorship Verification
    Hung, Chia-Yu
    Hu, Zhiqiang
    Hu, Yujia
    Lee, Roy Ka-Wei
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 14078 - 14084
  • [47] CoLE: A collaborative legal expert prompting framework for large language models in law
    Li, Bo
    Fan, Shuang
    Zhu, Shaolin
    Wen, Lijie
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [48] MEEP: Is this Engaging? Prompting Large Language Models for Dialogue Evaluation in Multilingual Settings
    Ferron, Amila
    Shore, Amber
    Mitra, Ekata
    Agrawal, Ameeta
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 2078 - 2100
  • [49] Instructing and Prompting Large Language Models for Explainable Cross-domain Recommendations
    Petruzzelli, Alessandro
    Musto, Cataldo
    Laraspata, Lucrezia
    Rinaldi, Ivan
    de Gemmis, Marco
    Lops, Pasquale
    Semeraro, Giovanni
    PROCEEDINGS OF THE EIGHTEENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2024, 2024, : 298 - 308
  • [50] Fairness-guided Few-shot Prompting for Large Language Models
    Ma, Huan
    Zhang, Changqing
    Bian, Yatao
    Liu, Lemao
    Zhang, Zhirui
    Zhao, Peilin
    Zhang, Shu
    Fu, Huazhu
    Hu, Qinghua
    Wu, Bingzhe
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,