Rubric Reliability and Annotation of Content and Argument in Source-Based Argument Essays

被引：0

作者：

Gao, Yanjun ^{[1
]}

Driban, Alex ^{[1
]}

McManus, Brennan Xavier ^{[2
]}

Musi, Elena ^{[3
]}

Davies, Patricia M. ^{[4
]}

Muresan, Smaranda ^{[2
]}

Passonneau, Rebecca J. ^{[1
]}

机构：

[1] Penn State Univ, Dept Comp Sci & Engn, University Pk, PA 16802 USA

[2] Columbia Univ, Dept Comp Sci, New York, NY 10027 USA

[3] Univ Liverpool, Dept Commun & Media, Liverpool, Merseyside, England

[4] Prince Mohammad Bin Fahd Univ, Coll Sci & Human Studies, Khobar, Saudi Arabia

来源：

INNOVATIVE USE OF NLP FOR BUILDING EDUCATIONAL APPLICATIONS | 2019年

关键词：

HIGH-SCHOOL-STUDENTS;

D O I：

暂无

中图分类号：

H0 [语言学];

学科分类号：

030303 ; 0501 ; 050102 ;

摘要：

We present a unique dataset of student source-based argument essays to facilitate research on the relations between content, argumentation skills, and assessment. Two classroom writing assignments were given to college students in a STEM major, accompanied by a carefully designed rubric. The paper presents a reliability study of the rubric, showing it to be highly reliable, and initial annotation on content and argumentation annotation of the essays.

引用

页码：507 / 518

页数：12

共 15 条

[1] US Secondary Students' Source-Based Argument Writing in History
Steiss, Jacob
Wang, Jiali
Kim, Young-Suk Grace
Olson, Carol Booth
[J]. WRITTEN COMMUNICATION, 2024, 41 (04) : 693 - 725
[2] Source-Based Taxing Rights from the OECD to the UN Model Conventions: Unavailing Efforts and an Argument for Reform
Eyitayo-Oyesode, Oladiwura Ayeyemi
[J]. LAW AND DEVELOPMENT REVIEW, 2020, 13 (01) : 193 - 227
[3] Attitude Toward Sustainable Transport as a Function of Source and Argument Reliability and Anticipated Emotions
Manca, Sara
Fornara, Ferdinando
[J]. SUSTAINABILITY, 2019, 11 (12):
[4] Automatic identification of knowledge-transforming content in argument essays developed from multiple sources
Rakovic, Mladen
Winne, Philip H.
Marzouk, Zahia
Chang, Daniel
[J]. JOURNAL OF COMPUTER ASSISTED LEARNING, 2021, 37 (04) : 903 - 924
[5] An Argument-Based Framework for Selecting Dialogue Move Types and Content
Snaith, Mark
[J]. COMPUTATIONAL MODELS OF ARGUMENT (COMMA 2020), 2020, 326 : 355 - 362
[6] Development and initial argument-based validation of a scoring rubric used in the assessment of L2 writing electronic portfolios
Lallmamode, Sheila Parveen
Daud, Nuraihan Mat
Abu Kassim, Noor Lide
[J]. ASSESSING WRITING, 2016, 30 : 44 - 62
[7] Development of argument based opinion mining model with sentimental data analysis from twitter content
Arumugam, S. S.
[J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (15):
[8] Translation-Based Implicit Annotation Projection for Zero-Shot Cross-Lingual Event Argument Extraction
Lou, Chenwei
Gao, Jun
Yu, Changlong
Wang, Wei
Zhao, Huan
Tu, Weiwei
Xu, Ruifeng
[J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2076 - 2081
[9] Comprehension and Writing Strategy Training Improves Performance on Content-Specific Source-Based Writing Tasks
Weston-Sementelli J.L.
Allen L.K.
McNamara D.S.
[J]. International Journal of Artificial Intelligence in Education, 2018, 28 (1) : 106 - 137
[10] Research on the Evaluation Model for Selection of the Argument's Type and Content in Argumentation-based Negotiation of Agent
Jiang, Guorui
Hu, Xiaoyu
[J]. INFORMATION SYSTEMS IN THE CHANGING ERA: THEORY AND PRACTICE, 2009, : 173 - 180

← 1 2 →