Potential Pitfalls of False Positives

被引:0
|
作者
Dey, Indrani [1 ]
Gnesdilow, Dana [1 ]
Passonneau, Rebecca [2 ]
Puntambekar, Sadhana [1 ]
机构
[1] Univ Wisconsin Madison, Madison, WI 53706 USA
[2] Penn State Univ, State Coll, PA 16801 USA
关键词
AI Accuracy; Automated Feedback; Science Writing;
D O I
10.1007/978-3-031-64315-6_45
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automated writing evaluation (AWE) systems automatically assess and provide students with feedback on their writing. Despite learning benefits, students may not effectively interpret and utilize AI-generated feedback, thereby not maximizing their learning outcomes. A closely related issue is the accuracy of the systems, that students may not understand, are not perfect. Our study investigates whether students differentially addressed false positive and false negative AI-generated feedback errors on their science essays. We found that students addressed nearly all the false negative feedback; however, they addressed less than one-fourth of the false positive feedback. The odds of addressing a false positive feedback was 99% lower than addressing a false negative feedback, representing significant missed opportunities for revision and learning. We discuss the implications of these findings in the context of students' learning.
引用
收藏
页码:469 / 476
页数:8
相关论文
共 50 条