Development of an Adaptive User Support System Based on Multimodal Large Language Models

被引：0

作者：

Wang, Wei ^{[1
]}

Li, Lin ^{[2
]}

Wickramathilaka, Shavindra ^{[1
]}

Grundy, John ^{[1
]}

Khalajzadeh, Hourieh ^{[3
]}

Obie, Humphrey O. ^{[1
]}

Madugalla, Anuradha ^{[1
]}

机构：

[1] Monash Univ, Dept Software Syst & Cybersecur, Melbourne, Vic, Australia

[2] RMIT Univ, Dept Informat Syst & Business Analyt, Melbourne, Vic, Australia

[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia

来源：

2024 IEEE SYMPOSIUM ON VISUAL LANGUAGES AND HUMAN-CENTRIC COMPUTING, VL/HCC 2024 | 2024年

关键词：

Adaptive User Support; User Interface; Multimodal Large Language Models (MLLMs);

D O I：

10.1109/VL/HCC60511.2024.00044

中图分类号：

学科分类号：

摘要：

As software systems become more complex, some users find it challenging to use these tools efficiently, leading to frustration and decreased productivity. We tackle the shortcomings of conventional user support mechanisms in software and aim to create and assess a user support system that integrates Multimodal Large Language Models (MLLMs) for producing support messages. Our system initially segments the user interface to serve as a reference for selection and requests users to specify their preferences for support messages. Following this, the system creates personalised user support messages for each individual. We propose that user support systems enhanced with MLLMs can provide more efficient and bespoke assistance compared to conventional methods.

引用

页码：344 / 347

页数：4

共 50 条

[31] Development of Intelligent User Behavior Based Adaptive Rule Based System
Kohli, Shruti
Kumar, Ela
Joshi, B. P.
IIT: 2008 INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION TECHNOLOGY, 2008, : 651 - 655
[32] Fluctuation-Based Adaptive Structured Pruning for Large Language Models
An, Yongqi
Zhao, Xu
Yu, Tao
Tang, Ming
Wang, Jinqiao
THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 10865 - 10873
[33] The development of behavior-based user models for a computer system
Bushey, R
Mauney, JM
Deelman, T
UM99: USER MODELING, PROCEEDINGS, 1999, (407): : 109 - 118
[34] SEED-Bench: Benchmarking Multimodal Large Language Models
Li, Bohao
Ge, Yuying
Ge, Yixiao
Wang, Guangzhi
Wang, Rui
Zhang, Ruimao
Shi, Ying
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 13299 - 13308
[35] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
Jain, Jitesh
Yang, Jianwei
Shi, Humphrey
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 27992 - 28002
[36] Large Language and Emerging Multimodal Foundation Models: Boundless Opportunities
Forghani, Reza
RADIOLOGY, 2024, 313 (01)
[37] Multimodal large language models for inclusive collaboration learning tasks
Lewis, Armanda
NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE STUDENT RESEARCH WORKSHOP, 2022, : 202 - 210
[38] Large Language and Multimodal Models Don't Come Cheap
Anderson, Margo
Perry, Tekla S.
IEEE SPECTRUM, 2023, 60 (07) : 13 - 13
[39] Large Language Models in Rheumatologic Diagnosis: A Multimodal Performance Analysis
Omar, Mahmud
Agbareia, Reem
Klang, Eyal
Naffaa, Mohammaed E.
JOURNAL OF RHEUMATOLOGY, 2025, 52 (02) : 187 - 188
[40] Exploring the Transferability of Visual Prompting for Multimodal Large Language Models
Zhang, Yichi
Dong, Yinpeng
Zhang, Siyuan
Min, Tianzan
Su, Hang
Zhu, Jun
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 26552 - 26562

← 1 2 3 4 5 →