Quickest Detection POMDPs With Social Learning: Interaction of Local and Global Decision Makers

被引:39
|
作者
Krishnamurthy, Vikram [1 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Adaptive sensing; Blackwell dominance; multiagent sensor scheduling; partially observed Markov decision process (POMDP); phase-type distribution; quickest time Bayesian change detection; social learning; stochastic dominance; ALGORITHMS; MODEL; TIME;
D O I
10.1109/TIT.2012.2201372
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider how local and global decision policies interact in stopping time problems such as quickest time change detection. Individual agents make myopic local decisions via social learning, that is, each agent records a private observation of a noisy underlying state process, selfishly optimizes its local utility and then broadcasts its local decision. Given these local decisions, how can a global decision maker achieve quickest time change detection when the underlying state changes according to a phase-type distribution? This paper presents four results. First, using Blackwell dominance of measures, it is shown that the optimal cost incurred in social-learning-based quickest detection is always larger than that of classical quickest detection. Second, it is shown that in general the optimal decision policy for social-learning-based quickest detection is characterized by multiple thresholds within the space of Bayesian distributions. Third, using lattice programming and stochastic dominance, sufficient conditions are given for the optimal decision policy to consist of a single linear hyperplane, or, more generally, a threshold curve. Estimation of the optimal linear approximation to this threshold curve is formulated as a simulation-based stochastic optimization problem. Finally, this paper shows that in multiagent sensor management with quickest detection, where each agent views the world according to its prior, the optimal policy has a similar structure to social learning.
引用
收藏
页码:5563 / 5587
页数:25
相关论文
共 50 条
  • [1] QUICKEST TIME CHANGE DETECTION WITH SOCIAL LEARNING
    Krishnamurthy, Vikram
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 5257 - 5260
  • [2] Quickest Time Detection and Constrained Optimal Social Learning with Variance Penalty
    Krishnamurthy, Vikram
    [J]. 49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 1102 - 1107
  • [3] Local Exceptionality Detection on Social Interaction Networks
    Atzmueller, Martin
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2016, PT III, 2016, 9853 : 298 - 302
  • [4] Global collaboration through local interaction in competitive learning
    Siddiqui, Abbas
    Georgiadis, Dionysios
    [J]. NEURAL NETWORKS, 2020, 123 : 393 - 400
  • [5] Local decision makers’ awareness of the social determinants of health in Turkey: a cross-sectional study
    Evci (Kiraz) Emine Didem
    Ergin Filiz
    Okur Orhan
    Saruhan Gulnur
    Beser Erdal
    [J]. BMC Public Health, 12
  • [6] Local decision makers' awareness of the social determinants of health in Turkey: a cross-sectional study
    Didem, Evci Emine
    Filiz, Ergin
    Orhan, Okur
    Gulnur, Saruhan
    Erdal, Beser
    [J]. BMC PUBLIC HEALTH, 2012, 12
  • [7] Implementing Rapid Climate Action: Learning from the 'Practical Wisdom' of Local Decision-Makers
    Yuille, Andy
    Tyfield, David
    Willis, Rebecca
    [J]. SUSTAINABILITY, 2021, 13 (10)
  • [8] Learning Global and Local Features for License Plate Detection
    Wang, Sheng
    Jia, Wenjing
    Wu, Qiang
    He, Xiangjian
    Yang, Jie
    [J]. NEURAL INFORMATION PROCESSING, PT III, 2011, 7064 : 547 - +
  • [9] Local to Global Feature Learning for Salient Object Detection
    Feng, Xuelu
    Zhou, Sanping
    Zhu, Zixin
    Wang, Le
    Hua, Gang
    [J]. PATTERN RECOGNITION LETTERS, 2022, 162 : 81 - 88
  • [10] DETECTION OF COMPONENT VIBRATIONS IN REACTORS BASED ON THE LOCAL-GLOBAL INTERACTION
    ALAMMAR, A
    DANOFSKY, RA
    [J]. TRANSACTIONS OF THE AMERICAN NUCLEAR SOCIETY, 1981, 39 : 955 - 956