共 50 条
Potential Pitfalls of False Positives
被引:0
|作者:
Dey, Indrani
[1
]
Gnesdilow, Dana
[1
]
Passonneau, Rebecca
[2
]
Puntambekar, Sadhana
[1
]
机构:
[1] Univ Wisconsin Madison, Madison, WI 53706 USA
[2] Penn State Univ, State Coll, PA 16801 USA
关键词:
AI Accuracy;
Automated Feedback;
Science Writing;
D O I:
10.1007/978-3-031-64315-6_45
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
Automated writing evaluation (AWE) systems automatically assess and provide students with feedback on their writing. Despite learning benefits, students may not effectively interpret and utilize AI-generated feedback, thereby not maximizing their learning outcomes. A closely related issue is the accuracy of the systems, that students may not understand, are not perfect. Our study investigates whether students differentially addressed false positive and false negative AI-generated feedback errors on their science essays. We found that students addressed nearly all the false negative feedback; however, they addressed less than one-fourth of the false positive feedback. The odds of addressing a false positive feedback was 99% lower than addressing a false negative feedback, representing significant missed opportunities for revision and learning. We discuss the implications of these findings in the context of students' learning.
引用
收藏
页码:469 / 476
页数:8
相关论文