Mobile User Interface Adaptation Based on Usability Reward Model and Multi-Agent Reinforcement Learning

被引:0
|
作者
Vidmanov, Dmitry [1 ]
Alfimtsev, Alexander [1 ]
机构
[1] Bauman Moscow State Tech Univ, Informat Syst & Telecommun, Moscow 105005, Russia
关键词
deep learning; reinforcement learning; multi-agent systems; adaptive systems; mobile user interface; usability; user experience; LEVEL;
D O I
10.3390/mti8040026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Today, reinforcement learning is one of the most effective machine learning approaches in the tasks of automatically adapting computer systems to user needs. However, implementing this technology into a digital product requires addressing a key challenge: determining the reward model in the digital environment. This paper proposes a usability reward model in multi-agent reinforcement learning. Well-known mathematical formulas used for measuring usability metrics were analyzed in detail and incorporated into the usability reward model. In the usability reward model, any neural network-based multi-agent reinforcement learning algorithm can be used as the underlying learning algorithm. This paper presents a study using independent and actor-critic reinforcement learning algorithms to investigate their impact on the usability metrics of a mobile user interface. Computational experiments and usability tests were conducted in a specially designed multi-agent environment for mobile user interfaces, enabling the implementation of various usage scenarios and real-time adaptations.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning
    Chen, Zhao
    Zhang, Lei
    Pei, Yukui
    Jiang, Chunxiao
    Yin, Liuguo
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (01) : 350 - 364
  • [42] Decentralized Multi-Agent Reinforcement Learning in Average-Reward Dynamic DCOPs
    Duc Thien Nguyen
    Yeoh, William
    Lau, Hoong Chuin
    Zilberstein, Shlomo
    Zhang, Chongjie
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 1447 - 1455
  • [43] Multi-Agent Deep Reinforcement Learning With Progressive Negative Reward for Cryptocurrency Trading
    Kumlungmak, Kittiwin
    Vateekul, Peerapon
    [J]. IEEE ACCESS, 2023, 11 : 66440 - 66455
  • [44] Role differentiation process by division of reward function in multi-agent reinforcement learning
    Taniguchi, Tadahiro
    Tabuchi, Kazuma
    Sawaragi, Tetsuo
    [J]. 2008 PROCEEDINGS OF SICE ANNUAL CONFERENCE, VOLS 1-7, 2008, : 358 - +
  • [45] Towards Designing Optimal Reward Functions in Multi-Agent Reinforcement Learning Problems
    Grunitzki, Ricardo
    da Silva, Bruno C.
    Bazzan, Ana L. C.
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [46] Decentralized Multi-Agent Reinforcement Learning in Average-Reward Dynamic DCOPs
    Duc Thien Nguyen
    Yeoh, William
    Hoong Chuin Lau
    Zilberstein, Shlomo
    Zhang, Chongjie
    [J]. AAMAS'14: PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS, 2014, : 1341 - 1342
  • [47] Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks
    Jiang, Wei
    Feng, Gang
    Qin, Shuang
    Liu, Yijing
    [J]. IEEE ACCESS, 2019, 7 : 61856 - 61867
  • [48] Multi-Agent Reinforcement Learning Based Coded Computation for Mobile Ad Hoc Computing
    Wang, Baoqian
    Xie, Junfei
    Lu, Kejie
    Wan, Yan
    Fu, Shengli
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [49] Multi-Agent Reinforcement Learning Based File Caching Strategy in Mobile Edge Computing
    Yang, Yongjian
    Lou, Kaihao
    Wang, En
    Liu, Wenbin
    Shang, Jianwen
    Song, Xueting
    Li, Dawei
    Wu, Jie
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (06) : 3159 - 3174
  • [50] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    [J]. 2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413