LEVA: Using Large Language Models to Enhance Visual Analytics

被引:2
|
作者
Zhao, Yuheng [1 ]
Zhang, Yixing [1 ]
Zhang, Yu [2 ]
Zhao, Xinyi [1 ]
Wang, Junjie [1 ]
Shao, Zekai [1 ]
Turkay, Cagatay [3 ]
Chen, Siming [1 ]
机构
[1] Fudan Univ, Sch Data Sci, Shanghai 200437, Peoples R China
[2] Univ Oxford, Dept Comp Sci, Oxford OX1 2JD, England
[3] Univ Warwick, Coventry CV4 7AL, England
关键词
Data visualization; Visual analytics; Task analysis; Data analysis; Grammar; Codes; Annotations; Insight recommendation; mixed-initiative; interface agent; large language models; visual analytics; GUIDANCE; VISUALIZATION; TYPOLOGY;
D O I
10.1109/TVCG.2024.3368060
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Visual analytics supports data analysis tasks within complex domain problems. However, due to the richness of data types, visual designs, and interaction designs, users need to recall and process a significant amount of information when they visually analyze data. These challenges emphasize the need for more intelligent visual analytics methods. Large language models have demonstrated the ability to interpret various forms of textual data, offering the potential to facilitate intelligent support for visual analytics. We propose LEVA, a framework that uses large language models to enhance users' VA workflows at multiple stages: onboarding, exploration, and summarization. To support onboarding, we use large language models to interpret visualization designs and view relationships based on system specifications. For exploration, we use large language models to recommend insights based on the analysis of system status and data to facilitate mixed-initiative exploration. For summarization, we present a selective reporting strategy to retrace analysis history through a stream visualization and generate insight reports with the help of large language models. We demonstrate how LEVA can be integrated into existing visual analytics systems. Two usage scenarios and a user study suggest that LEVA effectively aids users in conducting visual analytics.
引用
收藏
页码:1830 / 1847
页数:18
相关论文
共 50 条
  • [31] A Visual Analytics Environment for Navigating Large Conceptual Models by Leveraging Generative Artificial Intelligence
    Gandee, Tyler J.
    Glaze, Sean C.
    Giabbanelli, Philippe J.
    MATHEMATICS, 2024, 12 (13)
  • [32] Exploring the new frontier of information extraction through large language models in urban analytics
    Crooks, Andrew
    Chen, Qingqing
    ENVIRONMENT AND PLANNING B-URBAN ANALYTICS AND CITY SCIENCE, 2024, 51 (03) : 565 - 569
  • [33] Using Large Language Models in Business Processes
    Grisold, Thomas
    vom Brocke, Jan
    Kratsch, Wolfgang
    Mendling, Jan
    Vidgof, Maxim
    BUSINESS PROCESS MANAGEMENT, BPM 2023, 2023, 14159 : XXIX - XXXI
  • [34] Accelerating Pharmacovigilance using Large Language Models
    Prakash, Mukkamala Venkata Sai
    Parab, Ganesh
    Veeramalla, Meghana
    Reddy, Siddartha
    Varun, V.
    Gopalakrishnan, Saisubramaniam
    Pagidipally, Vishal
    Vaddina, Vishal
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 1182 - 1183
  • [35] Applying Large Language Models to Enhance the Assessment of Parallel Functional Programming Assignments
    Grandel, Skyler
    Schmidt, Douglas C.
    Leach, Kevin
    2024 INTERNATIONAL WORKSHOP ON LARGE LANGUAGE MODELS FOR CODE, LLM4CODE 2024, 2024, : 102 - 110
  • [36] Large Language Models for Clinical Text Cleansing Enhance Medical Concept Normalization
    Abdulnazar, Akhila
    Roller, Roland
    Schulz, Stefan
    Kreuzthaler, Markus
    IEEE ACCESS, 2024, 12 : 147981 - 147990
  • [37] Large language models based vulnerability detection: How does it enhance performance?
    Xuan, Cho Do
    Quang, Dat Bui
    Quang, Vinh Dang
    INTERNATIONAL JOURNAL OF INFORMATION SECURITY, 2025, 24 (01)
  • [38] On Large Visual Language Models for Medical Imaging Analysis: An Empirical Study
    Minh-Hao Van
    Verma, Prateek
    Wu, Xintao
    2024 IEEE/ACM CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES, CHASE 2024, 2024, : 172 - 176
  • [39] High Efficiency Image Compression for Large Visual-Language Models
    Li, Binzhe
    Wang, Shurun
    Wang, Shiqi
    Ye, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2870 - 2880
  • [40] ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models
    Zhou, Kaiwen
    Lee, Kwonjoon
    Misu, Teruhisa
    Wang, Xin Eric
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 10783 - 10795