Using Markov Decision Process to Model Deception for Robotic and Interactive Game Applications

被引:0
|
作者
Ayub, Ali [1 ]
Morales, Aldo [2 ]
Banerjee, Amit [3 ]
机构
[1] Penn State Univ, Dept Elect Engn, State Coll, PA 16802 USA
[2] Penn State Harrisburg, Dept Elect Engn, Middletown, PA 17057 USA
[3] Penn State Harrisburg, Dept Mech Engn, Middletown, PA 17057 USA
关键词
Human-Computer Interaction (HCI); Robotics; Deception; Interactive Gaines;
D O I
10.1109/ICCE50685.2021.9427633
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper investigates deception in the context of motion using a simulated mobile robot. We analyze some previously designed deceptive strategies on a mobile robot simulator. We then present a novel approach to adaptively choose target-oriented deceptive trajectories to deceive humans for multiple interactions. Additionally, we propose a new metric to evaluate deception on data collected from the users when interacting with the mobile robot simulator. We performed a user study to test our proposed adaptive deceptive algorithm, which shows that our algorithm deceives humans even for multiple interactions and it is more effective than random choice of deceptive strategies.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Evaluating Markov decision process as a model for decision making under uncertainty environment
    Moghadasi, Mahdi Naser
    Hachighat, Abolfazl Toroghi
    Ghidary, Saieed Shiriv
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 2446 - +
  • [32] Markov Decision Process Model for Patient Admission Decision at an Emergency Department in Disasters
    Lee, Hyun-Rok
    Lee, Taesik
    HEALTH CARE SYSTEMS ENGINEERING FOR SCIENTISTS AND PRACTITIONERS, 2016, 169 : 193 - 202
  • [33] A Higher-order interactive hidden Markov model and its applications
    Zhu, Dong-Mei
    Ching, Wai-Ki
    Elliott, Robert J.
    Siu, Tak-Kuen
    Zhang, Lianmin
    OR SPECTRUM, 2017, 39 (04) : 1055 - 1069
  • [34] A Higher-order interactive hidden Markov model and its applications
    Dong-Mei Zhu
    Wai-Ki Ching
    Robert J. Elliott
    Tak-Kuen Siu
    Lianmin Zhang
    OR Spectrum, 2017, 39 : 1055 - 1069
  • [35] Interactive Spoken Content Retrieval with Different Types of Actions Optimized by a Markov Decision Process
    Wen, Tsung-Hsien
    Lee, Hung-Yi
    Lee, Lin-Shan
    13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 2457 - 2460
  • [36] Interactive Spoken Document Retrieval With Suggested Key Terms Ranked by a Markov Decision Process
    Pan, Yi-Cheng
    Lee, Hung-Yi
    Lee, Lin-Shan
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2012, 20 (02): : 632 - 645
  • [37] A Markov Decision Process-based Collision Avoidance in IoT Applications
    Djiroun, Fatima Zahra
    Bagaa, Miloud
    Taleb, Tarik
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [38] Approximating the model of a water distribution network as a Markov decision process
    Misra, Rahul
    Wisniewski, Rafal
    Kallesoe, Carsten S.
    IFAC PAPERSONLINE, 2022, 55 (20): : 271 - 276
  • [39] A Markov decision process model on dynamic routing for target surveillance
    Margolis, Joshua T.
    Song, Yongjia
    Mason, Scott J.
    COMPUTERS & OPERATIONS RESEARCH, 2022, 141
  • [40] Using prospect game theory decision model in biddng decision
    Cheng, Min-Yuan
    Hsiang, Chia-Chi
    Journal of the Chinese Institute of Civil and Hydraulic Engineering, 2013, 25 (02): : 99 - 109