Human-AI collaboration patterns in AI-assisted academic writing

被引:8
|
作者
Nguyen, Andy [1 ,4 ]
Hong, Yvonne [2 ]
Dang, Belle [1 ]
Huang, Xiaoshan [3 ]
机构
[1] Univ Oulu, Learning & Educ Technol LET Res Lab, Oulu, Finland
[2] Victoria Univ Wellington, Sch Informat Management, Wellington, New Zealand
[3] McGill Univ, Dept Educ & Counselling Psychol ECP, Montreal, PQ, Canada
[4] Univ Oulu, Pentti Kaiteran Katu 1, Oulu 90570, Finland
关键词
Higher education; artificial intelligence (AI); doctoral studies; academic writing; self-regulated learning; WORKING-MEMORY;
D O I
10.1080/03075079.2024.2323593
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Artificial Intelligence (AI) has increasingly influenced higher education, notably in academic writing where AI-powered assisting tools offer both opportunities and challenges. Recently, the rapid growth of generative AI (GAI) has brought its impacts into sharper focus, yet the dynamics of its utilisation in academic writing remain largely unexplored. This paper focuses on examining the nature of human-AI interactions in academic writing, specifically investigating the strategies doctoral students employ when collaborating with a GAI-powered assisting tool. This study involves 626 recorded activities on how ten doctoral students interact with GAI-powered assisting tool during academic writing. AI-driven learning analytics approach was adopted for three layered analyses: (1) data pre-processing and analysis with quantitative content analysis, (2) sequence analysis with Hidden Markov Model (HMM) and hierarchical sequence clustering, and (3) pattern analysis with process mining. Findings indicate that doctoral students engaging in iterative, highly interactive processes with the GAI-powered assisting tool generally achieve better performance in the writing task. In contrast, those who use GAI merely as a supplementary information source, maintaining a linear writing approach, tend to get lower writing performance. This study points to the need for further investigations into human-AI collaboration in learning in higher education, with implications for tailored educational strategies and solutions.
引用
收藏
页码:847 / 864
页数:18
相关论文
共 50 条
  • [1] Writing the rules in AI-assisted writing
    [J]. Nature Machine Intelligence, 2023, 5 : 469 - 469
  • [2] Writing the rules in AI-assisted writing
    不详
    [J]. NATURE MACHINE INTELLIGENCE, 2023, 5 (05) : 469 - 469
  • [3] Exploring students' perspectives on Generative AI-assisted academic writing
    Kim, Jinhee
    Yu, Seongryeong
    Detrick, Rita
    Li, Na
    [J]. EDUCATION AND INFORMATION TECHNOLOGIES, 2024,
  • [4] Specifying AI Objectives as a Human-AI Collaboration Problem
    Dragan, Anca
    [J]. AIES '19: PROCEEDINGS OF THE 2019 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY, 2019, : 329 - 329
  • [5] AI in Education, Learner Control, and Human-AI Collaboration
    Brusilovsky, Peter
    [J]. INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2024, 34 (01) : 122 - 135
  • [6] Improving Human-AI Collaboration With Descriptions of AI Behavior
    Cabrera Á.A.
    Perer A.
    Hong J.I.
    [J]. Proc. ACM Hum. Comput. Interact., 2023, CSCW1
  • [7] AI in Education, Learner Control, and Human-AI Collaboration
    Peter Brusilovsky
    [J]. International Journal of Artificial Intelligence in Education, 2024, 34 : 122 - 135
  • [8] The Challenges and Opportunities of AI-Assisted Writing: Developing AI Literacy for the AI Age
    Cardon, Peter
    Fleischmann, Carolin
    Aritz, Jolanta
    Logemann, Minna
    Heidewald, Jeanette
    [J]. BUSINESS AND PROFESSIONAL COMMUNICATION QUARTERLY, 2023, 86 (03) : 257 - 295
  • [9] Human-AI Collaboration with Bandit Feedback
    Gao, Ruijiang
    Saar-Tsechansky, Maytal
    De-Arteaga, Maria
    Han, Ligong
    Lee, Min Kyung
    Lease, Matthew
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1722 - 1728
  • [10] Human-AI Collaboration in Recruitment and Selection
    Natarajan, Neil
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 7089 - 7090