PIQARD System for Experimenting and Testing Language Models with Prompting Strategies

被引：0

作者：

Korcz, Marcin ^{[1
]}

Plaskowski, Dawid ^{[1
]}

Politycki, Mateusz ^{[1
]}

Stefanowski, Jerzy ^{[1
]}

Terentowicz, Alex ^{[1
]}

机构：

[1] Poznan Univ Tech, Inst Comp Sci, Poznan, Poland

来源：

MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2023, PT VII | 2023年 / 14175卷

关键词：

Large language models; Prompting; Information retrieval;

D O I：

10.1007/978-3-031-43430-3_23

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Large Language Models (LLMs) have seen a surge in popularity due to their impressive results in natural language processing tasks, but there are still challenges to be addressed. Prompting in the question is a solution for some of them. In this paper, we present PIQARD, an open-source Python library that allows researchers to experiment with prompting techniques and information retrieval, and combine them with LLMs. This library includes pre-implemented components and also allows users to integrate their own methods.

引用

页码：320 / 323

页数：4

共 50 条

[31] Exploring the Transferability of Visual Prompting for Multimodal Large Language Models
Zhang, Yichi
Dong, Yinpeng
Zhang, Siyuan
Min, Tianzan
Su, Hang
Zhu, Jun
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 26552 - 26562
[32] An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing: Algorithm Development and Validation Study
Sivarajkumar, Sonish
Kelley, Mark
Samolyk-Mazzanti, Alyssa
Visweswaran, Shyam
Wang, Yanshan
JMIR MEDICAL INFORMATICS, 2024, 12
[33] Does Metacognitive Prompting Improve Causal Inference in Large Language Models?
Ohtani, Ryusei
Sakurai, Yuko
Oyama, Satoshi
2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 458 - 459
[34] Multi-Modal Attribute Prompting for Vision-Language Models
Liu, Xin
Wu, Jiamin
Yang, Wenfei
Zhou, Xu
Zhang, Tianzhu
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11579 - 11591
[35] PAM: Prompting Audio-Language Models for Audio Quality Assessment
Deshmukh, Soham
Alharthi, Dareen
Elizalde, Benjamin
Gamper, Hannes
Al Ismail, Mahmoud
Singh, Rita
Raj, Bhiksha
Wang, Huaming
INTERSPEECH 2024, 2024, : 3320 - 3324
[36] On Hardware Security Bug Code Fixes by Prompting Large Language Models
Ahmad, Baleegh
Thakur, Shailja
Tan, Benjamin
Karri, Ramesh
Pearce, Hammond
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 4043 - 4057
[37] SATLM: Satisfiability-Aided Language Models Using Declarative Prompting
Ye, Xi
Chen, Qiaochu
Dillig, Isil
Durrett, Greg
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
[38] Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, Jason
Wang, Xuezhi
Schuurmans, Dale
Bosma, Maarten
Ichter, Brian
Xia, Fei
Chi, Ed H.
Le, Quoc V.
Zhou, Denny
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
[39] The Application of Probing Prompting Learning Models in Mastering Foreign Language Vocabulary
Usman, Misnawaty
Adys, Himala Praptami
Rosmaladewi, Rosmaladewi
Asnur, Muhammad Nur Ashar
IJOLE-INTERNATIONAL JOURNAL OF LANGUAGE EDUCATION, 2023, 7 (04): : 702 - 710
[40] Correction: Standardized nomenclature for litigational legal prompting in generative language models
Aditya Sivakumar
Ben Gelman
Robert Simmons
Discover Artificial Intelligence, 4 (1):

← 1 2 3 4 5 →