GenNI: Human-AI Collaboration for Data-Backed Text Generation

被引:8
|
作者
Strobelt, Hendrik [1 ,2 ]
Kinley, Jambay [3 ]
Krueger, Robert [4 ]
Beyer, Johanna [4 ]
Pfister, Hanspeter [4 ]
Rush, Alexander M. [3 ]
机构
[1] IBM Res, Cambridge, MA 02142 USA
[2] MIT IBM Watson AI Lab, Cambridge, MA 02142 USA
[3] Cornell Univ, New York, NY 10021 USA
[4] Harvard Univ, Cambridge, MA 02138 USA
关键词
Computational modeling; Visualization; Tools; Data models; Collaboration; Task analysis; Deep learning; Tabular Data; Text; Document Data; Machine Learning; Statistics; Modelling; Simulation Applications;
D O I
10.1109/TVCG.2021.3114845
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
引用
下载
收藏
页码:1106 / 1116
页数:11
相关论文
共 50 条
  • [21] AI-Driven Personalization to Support Human-AI Collaboration
    Conati, Cristina
    COMPANION OF THE 2024 ACM SIGCHI SYMPOSIUM ON ENGINEERING INTERACTIVE COMPUTING SYSTEMS, EICS 2024, 2024, : 5 - 6
  • [22] HAIGEN: Towards Human-AI Collaboration for Facilitating Creativity and Style Generation in Fashion Design
    Jiang, Jianan
    Wu, Di
    Deng, Hanhui
    Long, Yidan
    Tang, Wenyi
    Li, Xiang
    Liu, Can
    Jin, Zhanpeng
    Zhang, Wenlei
    Qi, Tangquan
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2024, 8 (03):
  • [23] Human-AI collaboration patterns in AI-assisted academic writing
    Nguyen, Andy
    Hong, Yvonne
    Dang, Belle
    Huang, Xiaoshan
    STUDIES IN HIGHER EDUCATION, 2024, 49 (05) : 847 - 864
  • [24] Supporting Human-AI Collaboration in Auditing LLMs with LLMs
    Rastogi, Charvi
    Ribeiro, Marco Tulio
    King, Nicholas
    Nori, Harsha
    Amershi, Saleema
    PROCEEDINGS OF THE 2023 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY, AIES 2023, 2023, : 913 - 926
  • [25] Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
    Khadpe P.
    Krishna R.
    Fei-Fei L.
    Hancock J.T.
    Bernstein M.S.
    Proceedings of the ACM on Human-Computer Interaction, 2020, 4 (CSCW2)
  • [26] Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation
    Holter, Steffen
    El-Assady, Mennatallah
    COMPUTER GRAPHICS FORUM, 2024, 43 (03)
  • [27] Hybrid intelligence: human-AI collaboration in marketing analytics
    Petrescu, Maria
    Krishen, Anjala S.
    JOURNAL OF MARKETING ANALYTICS, 2023, 11 (03) : 263 - 274
  • [28] A human-AI collaboration workflow for archaeological sites detection
    Casini, Luca
    Marchetti, Nicolo
    Montanucci, Andrea
    Orru, Valentina
    Roccetti, Marco
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [29] Opportunities for Human-AI Collaboration in Remote Sighted Assistance
    Lee, Sooyeon
    Yu, Rui
    Xie, Jingyi
    Billah, Syed Masum
    Carroll, John M.
    IUI'22: 27TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2022, : 63 - 78
  • [30] Uncalibrated Models Can Improve Human-AI Collaboration
    Vodrahalli, Kailas
    Gerstenberg, Tobias
    Zou, James
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,