GenNI: Human-AI Collaboration for Data-Backed Text Generation

被引:8
|
作者
Strobelt, Hendrik [1 ,2 ]
Kinley, Jambay [3 ]
Krueger, Robert [4 ]
Beyer, Johanna [4 ]
Pfister, Hanspeter [4 ]
Rush, Alexander M. [3 ]
机构
[1] IBM Res, Cambridge, MA 02142 USA
[2] MIT IBM Watson AI Lab, Cambridge, MA 02142 USA
[3] Cornell Univ, New York, NY 10021 USA
[4] Harvard Univ, Cambridge, MA 02138 USA
关键词
Computational modeling; Visualization; Tools; Data models; Collaboration; Task analysis; Deep learning; Tabular Data; Text; Document Data; Machine Learning; Statistics; Modelling; Simulation Applications;
D O I
10.1109/TVCG.2021.3114845
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
引用
收藏
页码:1106 / 1116
页数:11
相关论文
共 50 条
  • [41] Investigating Trust in Human-AI Collaboration for a Speech-Based Data Analytics Task
    Tutul, Abdullah Aman
    Nirjhar, Ehsanul Haque
    Chaspari, Theodora
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024, 41 (05) : 2936 - 2954
  • [42] From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People
    Wang, Dakuo
    Shneiderman, Ben
    Churchill, Elizabeth
    Shi, Yuanchun
    Maes, Pattie
    Fan, Xiangmin
    Wang, Qianying
    CHI'20: EXTENDED ABSTRACTS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2020,
  • [43] AI and XAI second opinion: the danger of false confirmation in human-AI collaboration
    Rosenbacke, Rikard
    Melhus, Asa
    McKee, Martin
    Stuckler, David
    JOURNAL OF MEDICAL ETHICS, 2024,
  • [44] Human-AI Collaboration in Quality Control with Augmented Manufacturing Analytics
    Bousdekis, Alexandros
    Wellsandt, Stefan
    Bosani, Enrica
    Lepenioti, Katerina
    Apostolou, Dimitris
    Hribernik, Karl
    Mentzas, Gregoris
    ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: ARTIFICIAL INTELLIGENCE FOR SUSTAINABLE AND RESILIENT PRODUCTION SYSTEMS, APMS 2021, PT IV, 2021, 633 : 303 - 310
  • [45] Preparing Future Designers for Human-AI Collaboration in Persona Creation
    Goel, Toshali
    Shaer, Orit
    Gu, Quan
    Delcourt, Catherine
    Cooper, Angel
    PROCEEDINGS OF THE 2ND ANNUAL MEETING OF THE SYMPOSIUM ON HUMAN-COMPUTER INTERACTION FOR WORK, CHIWORK 2023, 2023,
  • [46] REGROW: Reimagining Global Crowdsourcing for Better Human-AI Collaboration
    Alorwu, Andy
    Savage, Saiph
    van Berkel, Niels
    Ustalov, Dmitry
    Drutsa, Alexey
    Oppenlaender, Jonas
    Bates, Oliver
    Hettiachchi, Danula
    Gadiraju, Ujwal
    Goncalves, Jorge
    Hosio, Simo
    EXTENDED ABSTRACTS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2022, 2022,
  • [47] Applications of Human-AI Collaboration: Insights from Theory and Practice
    Oeste-Reiß, Sarah
    Bittner, Eva
    Ebel, Philipp Alexander
    Söllner, Matthias
    Proceedings of the Annual Hawaii International Conference on System Sciences, 2022, 2022-January : 194 - 195
  • [48] Colorbo: Envisioned Mandala Coloring through Human-AI Collaboration
    Kim, Eunseo
    Hong, Jeongmin
    Lee, Hyuna
    Ko, Minsam
    IUI'22: 27TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2022, : 15 - 26
  • [49] Understanding Choice Independence and Error Types in Human-AI Collaboration
    Erlei, Alexander
    Sharma, Abhinav
    Gadiraju, Ujwal
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,
  • [50] Applications of Human-AI Collaboration: Insights from Theory and Practice
    Söllner, Matthias
    Bittner, Eva
    Ebel, Philipp Alexander
    Oeste-Reiß, Sarah
    Proceedings of the Annual Hawaii International Conference on System Sciences, 2023, 2023-January