Risk or Chance? Large Language Models and Reproducibility in HCI Research

被引：0
|
作者：
Kosch, Thomas [1 ]
Feger, Sebastian [2 ]
机构：
[1] Humboldt University of Berlin, Germany
[2] TH Rosenheim, Germany
来源：
Interactions (N.Y.) | 2024年 / 31卷 / 06期
关键词：
D O I：
10.1145/3695765
中图分类号：
学科分类号：
摘要：
The rapid adoption of LLMs signifies their potential to become commonplace tools for data analysis and substitutes for human study participants in HCI research. Anticipated reproducibility challenges surrounding LLM adoption in HCI, including bias, data-analysis support, documentation requirements, and publication pressure, highlight the need for proactive discussions and the development of best practices.
引用
收藏
页码：44 / 49
相关论文
共 50 条
  • [1] Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study
    Hamalainen, Perttu
    Tavast, Mikke
    Kunnari, Anton
    [J]. PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023, 2023,
  • [2] Risk communication and large language models
    Sledge, Daniel
    Thomas, Herschel F.
    [J]. RISK HAZARDS & CRISIS IN PUBLIC POLICY, 2024,
  • [3] Autonomous chemical research with large language models
    Boiko, Daniil A.
    Macknight, Robert
    Kline, Ben
    Gomes, Gabe
    [J]. NATURE, 2023, 624 (7992) : 570 - +
  • [4] Autonomous chemical research with large language models
    Daniil A. Boiko
    Robert MacKnight
    Ben Kline
    Gabe Gomes
    [J]. Nature, 2023, 624 : 570 - 578
  • [5] Debiasing large language models: research opportunities
    Yogarajan, Vithya
    Dobbie, Gillian
    Keegan, Te Taka
    [J]. JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2024,
  • [6] Research and Application of Large Language Models in Healthcare
    Zhou, Chunfang
    Gong, Qingyue
    Zhu, Jinyang
    Luan, Huidan
    [J]. PROCEEDINGS OF 2023 4TH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE FOR MEDICINE SCIENCE, ISAIMS 2023, 2023, : 664 - 670
  • [7] Performance and Accuracy Research of the Large Language Models
    Gaitan, Nicoleta Cristina
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (08) : 62 - 69
  • [8] Demystifying large language models in second language development research
    Cong, Yan
    [J]. COMPUTER SPEECH AND LANGUAGE, 2025, 89
  • [9] Transforming HCI Research Cycles using Generative AI and "Large Whatever Models" (LWMs)
    Elagroudy, Passant
    Li, Jie
    Vaananen, Kaisa
    Lukowicz, Paul
    Ishii, Hiroshi
    Mackay, Wendy E.
    Churchill, Elizabeth F.
    Peters, Anicia
    Oulasvirta, Antti
    Prada, Rui
    Diening, Alexandra
    Barbareschi, Giulia
    Gruenerbl, Agnes
    Kawaguchi, Midori
    El Ali, Abdallah
    Draxler, Fiona
    Welsch, Robin
    Schmidt, Albrecht
    [J]. EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [10] Large language models for plasma research : Curse or blessing?
    von Keudell, Achim
    [J]. PLASMA PROCESSES AND POLYMERS, 2024, 21 (07)
12345