Risk or Chance? Large Language Models and Reproducibility in HCI Research

被引：0

作者：

Kosch, Thomas ^{[1
]}

Feger, Sebastian ^{[2
]}

机构：

[1] Humboldt University of Berlin, Germany

[2] TH Rosenheim, Germany

来源：

Interactions (N.Y.) | 2024年 / 31卷 / 06期

关键词：

D O I：

10.1145/3695765

中图分类号：

学科分类号：

摘要：

The rapid adoption of LLMs signifies their potential to become commonplace tools for data analysis and substitutes for human study participants in HCI research. Anticipated reproducibility challenges surrounding LLM adoption in HCI, including bias, data-analysis support, documentation requirements, and publication pressure, highlight the need for proactive discussions and the development of best practices.

引用

页码：44 / 49

共 50 条

[21] Large language models are not fit for clinical practice ... and other research
Nolan, Tom
[J]. BMJ-BRITISH MEDICAL JOURNAL, 2024, 386
[22] Defining the Role of Large Language Models in Urologic Care and Research
Gupta, Raghav
Pedraza, Adriana M.
Gorin, Michael A.
Tewari, Ashutosh K.
[J]. EUROPEAN UROLOGY ONCOLOGY, 2024, 7 (01): : 1 - 13
[23] Why Large Language Models will (not) Kill Software Engineering Research
Di Penta, Massimiliano
[J]. PROCEEDINGS OF 2024 28TH INTERNATION CONFERENCE ON EVALUATION AND ASSESSMENT IN SOFTWARE ENGINEERING, EASE 2024, 2024, : 5 - 5
[24] Voices from the algorithm: Large language models in social research
Cox, Emily
Shirani, Fiona
Rouse, Paul
[J]. ENERGY RESEARCH & SOCIAL SCIENCE, 2024, 113
[25] How good are large language models at product risk assessment?
Collier, Zachary A.
Gruss, Richard J.
Abrahams, Alan S.
[J]. RISK ANALYSIS, 2024,
[26] Assessing the risk of takeover catastrophe from large language models
Baum, Seth D.
[J]. RISK ANALYSIS, 2024,
[27] Large Language Models are Not Models of Natural Language: They are Corpus Models
Veres, Csaba
[J]. IEEE ACCESS, 2022, 10 : 61970 - 61979
[28] Large Language Models
Cerf, Vinton G.
[J]. COMMUNICATIONS OF THE ACM, 2023, 66 (08) : 7 - 7
[29] Large Language Models
Vargas, Diego Collarana
Katsamanis, Nassos
[J]. ERCIM NEWS, 2024, (136): : 12 - 13
[30] Insights and Opportunities for HCI Research into Hurricane Risk Communication
Soden, Robert
Chilton, Lydia B.
Miles, Scott
Bicksler, Rebecca
Villanueva, Kaira Ray
Bica, Melissa
[J]. PROCEEDINGS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI' 22), 2022,

← 1 2 3 4 5 →