GenNI: Human-AI Collaboration for Data-Backed Text Generation

被引:8
|
作者
Strobelt, Hendrik [1 ,2 ]
Kinley, Jambay [3 ]
Krueger, Robert [4 ]
Beyer, Johanna [4 ]
Pfister, Hanspeter [4 ]
Rush, Alexander M. [3 ]
机构
[1] IBM Res, Cambridge, MA 02142 USA
[2] MIT IBM Watson AI Lab, Cambridge, MA 02142 USA
[3] Cornell Univ, New York, NY 10021 USA
[4] Harvard Univ, Cambridge, MA 02138 USA
关键词
Computational modeling; Visualization; Tools; Data models; Collaboration; Task analysis; Deep learning; Tabular Data; Text; Document Data; Machine Learning; Statistics; Modelling; Simulation Applications;
D O I
10.1109/TVCG.2021.3114845
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
引用
收藏
页码:1106 / 1116
页数:11
相关论文
共 50 条
  • [1] Scholastic: Graphical Human-AI Collaboration for Inductive and Interpretive Text Analysis
    Hong, Matt-Heun
    Marsh, Lauren A.
    Feuston, Jessica L.
    Ruppert, Janet
    Brubaker, Jed R.
    Szafr, Danielle Albers
    [J]. PROCEEDINGS OF THE 35TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2022, 2022,
  • [2] Reframing Human-AI Collaboration for Generating Free-Text Explanations
    Wiegreffe, Sarah
    Hessel, Jack
    Swayamdipta, Swabha
    Riedl, Mark
    Choi, Yejin
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 632 - 658
  • [3] Human-AI Collaboration Development: Interim Communication Rivalry of Generation
    Burukina, Olga
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE, SOFTWARE AND SYSTEMS ENGINEERING, 2020, 965 : 70 - 82
  • [4] Human-AI collaboration in data science: Exploring data scientists’ perceptions of automated AI
    Wang D.
    Weisz J.D.
    Muller M.
    Ram P.
    Geyer W.
    Dugan C.
    Tausczik Y.
    Samulowitz H.
    Gray A.
    [J]. Proceedings of the ACM on Human-Computer Interaction, 2019, 3 (CSCW):
  • [5] Human-AI Collaboration with Bandit Feedback
    Gao, Ruijiang
    Saar-Tsechansky, Maytal
    De-Arteaga, Maria
    Han, Ligong
    Lee, Min Kyung
    Lease, Matthew
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1722 - 1728
  • [6] Human-AI Collaboration in Recruitment and Selection
    Natarajan, Neil
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 7089 - 7090
  • [7] Diverse Conventions for Human-AI Collaboration
    Sarkar, Bidipta
    Shih, Andy
    Sadigh, Dorsa
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [8] AI in Education, Learner Control, and Human-AI Collaboration
    Brusilovsky, Peter
    [J]. INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2024, 34 (01) : 122 - 135
  • [9] Improving Human-AI Collaboration With Descriptions of AI Behavior
    Cabrera Á.A.
    Perer A.
    Hong J.I.
    [J]. Proc. ACM Hum. Comput. Interact., 2023, CSCW1
  • [10] AI in Education, Learner Control, and Human-AI Collaboration
    Peter Brusilovsky
    [J]. International Journal of Artificial Intelligence in Education, 2024, 34 : 122 - 135