Risk or Chance? Large Language Models and Reproducibility in HCI Research

被引：0
|
作者：
Kosch, Thomas [1 ]
Feger, Sebastian [2 ]
机构：
[1] Humboldt University of Berlin, Germany
[2] TH Rosenheim, Germany
来源：
Interactions (N.Y.) | 2024年 / 31卷 / 06期
关键词：
D O I：
10.1145/3695765
中图分类号：
学科分类号：
摘要：
The rapid adoption of LLMs signifies their potential to become commonplace tools for data analysis and substitutes for human study participants in HCI research. Anticipated reproducibility challenges surrounding LLM adoption in HCI, including bias, data-analysis support, documentation requirements, and publication pressure, highlight the need for proactive discussions and the development of best practices.
引用
收藏
页码：44 / 49
相关论文
共 50 条
  • [41] ChatGPT, Bard, and Large Language Models for Biomedical Research: Opportunities and Pitfalls
    Surendrabikram Thapa
    Surabhi Adhikari
    [J]. Annals of Biomedical Engineering, 2023, 51 : 2647 - 2651
  • [42] The Artificial intelligence large language models and neuropsychiatry practice and research ethic
    Zhong, Yi
    Chen, Yu-jun
    Zhou, Yang
    Lyu, Yan-Ao-Hai
    Yin, Jia-Jun
    Gao, Yu-jun
    [J]. ASIAN JOURNAL OF PSYCHIATRY, 2023, 84
  • [43] ZINify: Transforming Research Papers into Engaging Zines with Large Language Models
    Shriram, Jaidev
    Sreekala, Sanjayan
    [J]. ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT, 2023,
  • [44] Learning How to Use Large Language Models for Empirical Legal Research
    Stiglitz, Edward H.
    [J]. JOURNAL OF INSTITUTIONAL AND THEORETICAL ECONOMICS-ZEITSCHRIFT FUR DIE GESAMTE STAATSWISSENSCHAFT, 2024, 180 (02): : 239 - 243
  • [45] Applications of Artificial Intelligence and Large Language Models to Plastic Surgery Research
    Seth, Ishith
    Bulloch, Gabriella
    Rozen, Warren M.
    [J]. AESTHETIC SURGERY JOURNAL, 2023, 43 (10) : NP809 - NP810
  • [46] The current status and prospects of large language models in medical application and research
    Deng, Heng
    Zhou, Qian
    Zhang, Ziwei
    Zhou, Taohu
    Lin, Xiaoqing
    Xia, Yi
    Fan, Li
    Liu, Shiyuan
    [J]. CHINESE JOURNAL OF ACADEMIC RADIOLOGY, 2024,
  • [47] ChatGPT and large language models in orthopedics: from education and surgery to research
    Srijan Chatterjee
    Manojit Bhattacharya
    Soumen Pal
    Sang-Soo Lee
    Chiranjib Chakraborty
    [J]. Journal of Experimental Orthopaedics, 10
  • [48] Assessing the Risk of Bias in Randomized Clinical Trials With Large Language Models
    Lai, Honghao
    Ge, Long
    Sun, Mingyao
    Pan, Bei
    Huang, Jiajie
    Hou, Liangying
    Yang, Qiuyu
    Liu, Jiayi
    Liu, Jianing
    Ye, Ziying
    Xia, Danni
    Zhao, Weilong
    Wang, Xiaoman
    Liu, Ming
    Talukdar, Jhalok Ronjan
    Tian, Jinhui
    Yang, Kehu
    Estill, Janne
    [J]. JAMA NETWORK OPEN, 2024, 7 (05)
  • [49] Risk Considerations for the Department of Defense's Fielding of Large Language Models
    Blowers, Misty
    Salinas, Santos
    Bailey, Seth
    [J]. DISRUPTIVE TECHNOLOGIES IN INFORMATION SCIENCES VIII, 2024, 13058
  • [50] Large Language Models in der WissenschaftLarge language models in science
    Karl-Friedrich Kowalewski
    Severin Rodler
    [J]. Die Urologie, 2024, 63 (9) : 860 - 866
12345