GenNI: Human-AI Collaboration for Data-Backed Text Generation

被引:8
|
作者
Strobelt, Hendrik [1 ,2 ]
Kinley, Jambay [3 ]
Krueger, Robert [4 ]
Beyer, Johanna [4 ]
Pfister, Hanspeter [4 ]
Rush, Alexander M. [3 ]
机构
[1] IBM Res, Cambridge, MA 02142 USA
[2] MIT IBM Watson AI Lab, Cambridge, MA 02142 USA
[3] Cornell Univ, New York, NY 10021 USA
[4] Harvard Univ, Cambridge, MA 02138 USA
关键词
Computational modeling; Visualization; Tools; Data models; Collaboration; Task analysis; Deep learning; Tabular Data; Text; Document Data; Machine Learning; Statistics; Modelling; Simulation Applications;
D O I
10.1109/TVCG.2021.3114845
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
引用
下载
收藏
页码:1106 / 1116
页数:11
相关论文
共 50 条
  • [31] A Hierarchical Approach to Population Training for Human-AI Collaboration
    Loo, Yi
    Gong, Chen
    Meghjani, Malika
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 3011 - 3019
  • [32] Extending a Human-AI Collaboration Framework with Dynamism and Sociality
    Muller, Michael
    Weisz, Justin D.
    PROCEEDINGS OF THE 1ST ANNUAL MEETING OF THE SYMPOSIUM ON HUMAN-COMPUTER INTERACTION FOR WORK, CHIWORK 2022, 2022,
  • [33] Human-AI Collaboration: A Blessing or a Curse for Safety at Work?
    Waardenburg, Lauren
    TECNOSCIENZA-ITALIAN JOURNAL OF SCIENCE & TECHNOLOGY STUDIES, 2024, 15 (01): : 133 - 146
  • [34] Towards Responsible AI: Developing Explanations to Increase Human-AI Collaboration
    De Brito Duarte, Regina
    HHAI 2023: AUGMENTING HUMAN INTELLECT, 2023, 368 : 470 - 482
  • [35] How Being Outvoted by AI Teammates Impacts Human-AI Collaboration
    Hu, Mo
    Zhang, Guanglu
    Chong, Leah
    Cagan, Jonathan
    Goucher-Lambert, Kosa
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024,
  • [36] Decision-Oriented Dialogue for Human-AI Collaboration
    Lin, Jessy
    Tomlin, Nicholas
    Andreas, Jacob
    Eisner, Jason
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2024, 12 : 892 - 911
  • [37] CollEagle; Tangible Human-AI Interaction for Collocated Collaboration
    Adan, Olaf
    Houben, Steven
    HHAI 2023: AUGMENTING HUMAN INTELLECT, 2023, 368 : 416 - 418
  • [38] Identifying Challenges and Opportunities in Human-AI Collaboration in Healthcare
    Park, Sun Young
    Kuo, Pei-Yi
    Barbarin, Andrea
    Kaziunas, Elizabeth
    Chow, Astrid
    Singh, Karandeep
    Wilcox, Lauren
    Lasecki, Walter S.
    CONFERENCE COMPANION PUBLICATION OF THE 2019 COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING (CSCW'19 COMPANION), 2019, : 506 - 510
  • [39] Enhancing Human-AI (H-AI) Collaboration On Design Tasks Using An Interactive Text/Voice Artificial Intelligence (AI) Agent
    Makokha, Joseph M.
    PROCEEDINGS OF THE WORKING CONFERENCE ON ADVANCED VISUAL INTERFACES AVI 2022, 2022,
  • [40] To Classify is to Interpret: Building Taxonomies from Heterogeneous Data through Human-AI Collaboration
    Meier, Sebastian
    Glinka, Katrin
    PROCEEDINGS OF 2023 MENSCH UND COMPUTER, MUC 2023: Building Bridges, 2023, : 395 - 401