Risk or Chance? Large Language Models and Reproducibility in HCI Research

被引：0
|
作者：
Kosch, Thomas [1 ]
Feger, Sebastian [2 ]
机构：
[1] Humboldt University of Berlin, Germany
[2] TH Rosenheim, Germany
来源：
Interactions (N.Y.) | 2024年 / 31卷 / 06期
关键词：
Modeling languages;
D O I：
10.1145/3695765
中图分类号：
学科分类号：
摘要：
The rapid adoption of LLMs signifies their potential to become commonplace tools for data analysis and substitutes for human study participants in HCI research. Anticipated reproducibility challenges surrounding LLM adoption in HCI, including bias, data-analysis support, documentation requirements, and publication pressure, highlight the need for proactive discussions and the development of best practices.
引用
收藏
页码：44 / 49
相关论文
共 50 条
  • [1] Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study
    Hamalainen, Perttu
    Tavast, Mikke
    Kunnari, Anton
    PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023, 2023,
  • [2] Neural Language Models as What If? -Engines for HCI Research
    Hamalainen, Perttu
    Tavast, Mikke
    Kunnari, Anton
    COMPANION PROCEEDINGS OF THE 27TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2022 COMPANION, 2022, : 77 - 80
  • [3] Risk communication and large language models
    Sledge, Daniel
    Thomas, Herschel F.
    RISK HAZARDS & CRISIS IN PUBLIC POLICY, 2024,
  • [4] Autonomous chemical research with large language models
    Boiko, Daniil A.
    Macknight, Robert
    Kline, Ben
    Gomes, Gabe
    NATURE, 2023, 624 (7992) : 570 - +
  • [5] Research and Application of Large Language Models in Healthcare
    Zhou, Chunfang
    Gong, Qingyue
    Zhu, Jinyang
    Luan, Huidan
    PROCEEDINGS OF 2023 4TH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE FOR MEDICINE SCIENCE, ISAIMS 2023, 2023, : 664 - 670
  • [6] Performance and Accuracy Research of the Large Language Models
    Gaitan, Nicoleta Cristina
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (08) : 62 - 69
  • [7] Debiasing large language models: research opportunities
    Yogarajan, Vithya
    Dobbie, Gillian
    Keegan, Te Taka
    JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2025, 55 (02) : 372 - 395
  • [8] Autonomous chemical research with large language models
    Daniil A. Boiko
    Robert MacKnight
    Ben Kline
    Gabe Gomes
    Nature, 2023, 624 : 570 - 578
  • [9] The adoption of Large Language Models in economics research
    Feyzollahi, Maryam
    Rafizadeh, Nima
    ECONOMICS LETTERS, 2025, 250
  • [10] Demystifying large language models in second language development research
    Cong, Yan
    COMPUTER SPEECH AND LANGUAGE, 2025, 89
12345