The Pyramid Method: Incorporating human content selection variation in summarization evaluation

被引:6
|
作者
Nenkova, Ani [1 ,2 ]
Passonneau, Rebecca [1 ,3 ]
Mckeown, Kathleen [1 ,4 ]
机构
[1] Columbia University
[2] Department of Computer and Information Science, University of Pennsylvania, Levine Hall, 3330 Walnut Street, Philadelphia, PA 19104-6389
[3] Center for Computational Learning Systems, Columbia University, Mail Code 7717, 457 Riverside Drive, New York, NY 10115
[4] Columbia University, Computer Science Department, 1214 Amsterdam Ave, New York, NY 10027
关键词
28;
D O I
10.1145/1233912.1233913
中图分类号
学科分类号
摘要
引用
收藏
相关论文
共 50 条
  • [21] Physics-based keyframe selection for human motion summarization
    Athanasios Voulodimos
    Ioannis Rallis
    Nikolaos Doulamis
    Multimedia Tools and Applications, 2020, 79 : 3243 - 3259
  • [22] Summary Cloze: A New Task for Content Selection in Topic-Focused Summarization
    Deutsch, Daniel
    Roth, Dan
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3720 - 3729
  • [23] A Safe Landing Site Selection Method Based on Inverse Pyramid
    Chen L.-P.
    Gu Z.
    Chen C.-L.
    Li T.-Y.
    Wang T.
    Cao Y.
    Liu J.-M.
    Yuhang Xuebao/Journal of Astronautics, 2021, 42 (08): : 967 - 974
  • [24] Variation, natural selection, and information content - A simulation
    Testa, Bernard
    Bojarski, Andrzej J.
    CHEMISTRY & BIODIVERSITY, 2007, 4 (10) : 2458 - 2472
  • [25] A Novel Method for Summarization and Evaluation of Messages from Twitter
    Samant, Surender Singh
    Murthy, N. L. Bhanu
    Malapati, Aruna
    2017 NINTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION (ICAPR), 2017, : 422 - 427
  • [26] Automatic evaluation method for rushes summarization:: Experimentation and analysis
    Dumont, Emilie
    Merialdo, Bernard
    2008 INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING, 2008, : 502 - 509
  • [27] Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation
    Liu, Yixin
    Fabbri, Alexander R.
    Liu, Pengfei
    Zhao, Yilun
    Nan, Linyong
    Han, Ruilin
    Han, Simeng
    Joty, Shafiq
    Wu, Chien-Sheng
    Xiong, Caiming
    Radev, Dragomir
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 4140 - 4170
  • [28] Meta-Learning for Data Summarization Based on Instance Selection Method
    Smith-Miles, Kate
    Islam, Rafiqul
    2010 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2010,
  • [29] An effective method for quantifying and incorporating uncertainty in metamodel selection
    Xiao, Mi
    Yi, Yongsheng
    Zhang, Jinhao
    Li, Wei
    JOURNAL OF MECHANICAL SCIENCE AND TECHNOLOGY, 2019, 33 (03) : 1279 - 1291
  • [30] An effective method for quantifying and incorporating uncertainty in metamodel selection
    Mi Xiao
    Yongsheng Yi
    Jinhao Zhang
    Wei Li
    Journal of Mechanical Science and Technology, 2019, 33 : 1279 - 1291