Robust diagnostic classification via Q-learning

被引:0
|
作者
Victor Ardulov
Victor R. Martinez
Krishna Somandepalli
Shuting Zheng
Emma Salzman
Catherine Lord
Somer Bishop
Shrikanth Narayanan
机构
[1] University of Southern California,
[2] University of California San Francisco,undefined
[3] University of California Los Angeles,undefined
来源
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Machine learning (ML) models have demonstrated the power of utilizing clinical instruments to provide tools for domain experts in gaining additional insights toward complex clinical diagnoses. In this context these tools desire two additional properties: interpretability, being able to audit and understand the decision function, and robustness, being able to assign the correct label in spite of missing or noisy inputs. This work formulates diagnostic classification as a decision-making process and utilizes Q-learning to build classifiers that meet the aforementioned desired criteria. As an exemplary task, we simulate the process of differentiating Autism Spectrum Disorder from Attention Deficit-Hyperactivity Disorder in verbal school aged children. This application highlights how reinforcement learning frameworks can be utilized to train more robust classifiers by jointly learning to maximize diagnostic accuracy while minimizing the amount of information required.
引用
收藏
相关论文
共 50 条
  • [1] Robust diagnostic classification via Q-learning
    Ardulov, Victor
    Martinez, Victor R.
    Somandepalli, Krishna
    Zheng, Shuting
    Salzman, Emma
    Lord, Catherine
    Bishop, Somer
    Narayanan, Shrikanth
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [2] Robust Q-Learning
    Ertefaie, Ashkan
    McKay, James R.
    Oslin, David
    Strawderman, Robert L.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2021, 116 (533) : 368 - 381
  • [3] Distributionally Robust Q-Learning
    Liu, Zijian
    Bai, Qinxun
    Blanchet, Jose
    Dong, Perry
    Xu, Wei
    Zhou, Zhengqing
    Zhou, Zhengyuan
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [4] Deep Q-learning: A robust control approach
    Varga, Balazs
    Kulcsar, Balazs
    Chehreghani, Morteza Haghir
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (01) : 526 - 544
  • [5] On-Off Adversarially Robust Q-Learning
    Sahoo, Prachi Pratyusha
    Vamvoudakis, Kyriakos G.
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (03): : 749 - 754
  • [6] Q-Learning Algorithms: A Comprehensive Classification and Applications
    Jang, Beakcheol
    Kim, Myeonghwi
    Harerimana, Gaspard
    Kim, Jong Wook
    [J]. IEEE ACCESS, 2019, 7 : 133653 - 133667
  • [7] Split Deep Q-Learning for Robust Object Singulation
    Sarantopoulos, Iason
    Kiatos, Marios
    Doulgeri, Zoe
    Malassiotis, Sotiris
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6225 - 6231
  • [8] Q-LEARNING
    WATKINS, CJCH
    DAYAN, P
    [J]. MACHINE LEARNING, 1992, 8 (3-4) : 279 - 292
  • [9] Deep Reinforcement Learning: From Q-Learning to Deep Q-Learning
    Tan, Fuxiao
    Yan, Pengfei
    Guan, Xinping
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT IV, 2017, 10637 : 475 - 483
  • [10] Backward Q-learning: The combination of Sarsa algorithm and Q-learning
    Wang, Yin-Hao
    Li, Tzuu-Hseng S.
    Lin, Chih-Jui
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (09) : 2184 - 2193