LEVA: Using Large Language Models to Enhance Visual Analytics

被引:2
|
作者
Zhao, Yuheng [1 ]
Zhang, Yixing [1 ]
Zhang, Yu [2 ]
Zhao, Xinyi [1 ]
Wang, Junjie [1 ]
Shao, Zekai [1 ]
Turkay, Cagatay [3 ]
Chen, Siming [1 ]
机构
[1] Fudan Univ, Sch Data Sci, Shanghai 200437, Peoples R China
[2] Univ Oxford, Dept Comp Sci, Oxford OX1 2JD, England
[3] Univ Warwick, Coventry CV4 7AL, England
关键词
Data visualization; Visual analytics; Task analysis; Data analysis; Grammar; Codes; Annotations; Insight recommendation; mixed-initiative; interface agent; large language models; visual analytics; GUIDANCE; VISUALIZATION; TYPOLOGY;
D O I
10.1109/TVCG.2024.3368060
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Visual analytics supports data analysis tasks within complex domain problems. However, due to the richness of data types, visual designs, and interaction designs, users need to recall and process a significant amount of information when they visually analyze data. These challenges emphasize the need for more intelligent visual analytics methods. Large language models have demonstrated the ability to interpret various forms of textual data, offering the potential to facilitate intelligent support for visual analytics. We propose LEVA, a framework that uses large language models to enhance users' VA workflows at multiple stages: onboarding, exploration, and summarization. To support onboarding, we use large language models to interpret visualization designs and view relationships based on system specifications. For exploration, we use large language models to recommend insights based on the analysis of system status and data to facilitate mixed-initiative exploration. For summarization, we present a selective reporting strategy to retrace analysis history through a stream visualization and generate insight reports with the help of large language models. We demonstrate how LEVA can be integrated into existing visual analytics systems. Two usage scenarios and a user study suggest that LEVA effectively aids users in conducting visual analytics.
引用
收藏
页码:1830 / 1847
页数:18
相关论文
共 50 条
  • [1] Explaining Contextualization in Language Models using Visual Analytics
    Sevastjanova, Rita
    Kalouli, Aikaterini-Lida
    Beck, Christin
    Schaefer, Hanna
    El-Assady, Mennatallah
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 464 - 476
  • [2] Exploring the neural landscape: Visual analytics of neuron activation in large language models with NeuronautLLM
    Woodman, Ollie
    Wen, Zhen
    Lu, Hui
    Ren, Yiwen
    Zhu, Minfeng
    Chen, Wei
    GRAPHICAL MODELS, 2024, 136
  • [3] LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models
    Kahng, Minsuk
    Tenney, Ian
    Pushkarna, Mahima
    Liu, Michael Xieyang
    Wexler, James
    Reif, Emily
    Kallarackal, Krystal
    Chang, Minsuk
    Terry, Michael
    Dixon, Lucas
    EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [4] Using Large Language Models to Enhance the Reusability of Sensor Data
    Berenguer, Alberto
    Morejon, Adriana
    Tomas, David
    Mazon, Jose-Norberto
    SENSORS, 2024, 24 (02)
  • [5] Using Large Language Models to Enhance Programming Error Messages
    Leinonen, Juho
    Hellas, Arto
    Sarsa, Sami
    Reeves, Brent
    Denny, Paul
    Prather, James
    Becker, Brett A.
    PROCEEDINGS OF THE 54TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, VOL 1, SIGCSE 2023, 2023, : 563 - 569
  • [6] (Chinavis 2024) TextLens: large language models-powered visual analytics enhancing text clustering
    Peng, Ruixiao
    Dong, Yu
    Li, Guan
    Tian, Dong
    Shan, Guihua
    JOURNAL OF VISUALIZATION, 2025,
  • [7] Large Language Models are Visual Reasoning Coordinators
    Chen, Liangyu
    Li, Bo
    Shen, Sheng
    Yang, Jingkang
    Li, Chunyuan
    Keutzer, Kurt
    Darrell, Trevor
    Liu, Ziwei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [8] Visual cognition in multimodal large language models
    Buschoff, Luca M. Schulze
    Akata, Elif
    Bethge, Matthias
    Schulz, Eric
    NATURE MACHINE INTELLIGENCE, 2025, 7 (01) : 96 - 106
  • [9] Proactive Polypharmacy Management Using Large Language Models: Opportunities to Enhance Geriatric Care
    Rao, Arya
    Kim, John
    Lie, Winston
    Pang, Michael
    Fuh, Lanting
    Dreyer, Keith J.
    Succi, Marc D.
    JOURNAL OF MEDICAL SYSTEMS, 2024, 48 (01)
  • [10] Advanced large language models and visualization tools for data analytics learning
    Valverde-Rebaza, Jorge
    Gonzalez, Aram
    Navarro-Hinojosa, Octavio
    Noguez, Julieta
    FRONTIERS IN EDUCATION, 2024, 9