Transfer Learning for Quantum Classifiers: An Information-Theoretic Generalization Analysis

被引:2
|
作者
Jose, Sharu Theresa [1 ]
Simeone, Osvaldo [2 ]
机构
[1] Univ Birmingham, Dept Comp Sci, Birmingham, England
[2] Kings Coll London, Dept Engn, London, England
基金
欧洲研究理事会; 英国工程与自然科学研究理事会;
关键词
D O I
10.1109/ITW55543.2023.10160236
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A key component of a quantum machine learning model operating on classical inputs is the design of an embedding circuit mapping inputs to a quantum state. This paper studies a transfer learning setting in which classical-to-quantum embedding is carried out by an arbitrary parametric quantum circuit that is pre-trained based on data from a source task. At run time, a binary quantum classifier of the embedding is optimized based on data from the target task of interest. The average excess risk, i.e., the optimality gap, of the resulting classifier depends on how (dis)similar the source and target tasks are. We introduce a new measure of (dis)similarity between the binary quantum classification tasks via the trace distances. An upper bound on the optimality gap is derived in terms of the proposed task (dis)similarity measure, two Renyi mutual information terms between classical input and quantum embedding under source and target tasks, as well as a measure of complexity of the combined space of quantum embeddings and classifiers under the source task. The theoretical results are validated on a simple binary classification example.
引用
收藏
页码:532 / 537
页数:6
相关论文
共 50 条
  • [21] Information-theoretic competitive learning
    Kamimura, R
    IASTED: PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON MODELLING AND SIMULATION, 2003, : 359 - 365
  • [22] Information-Theoretic Odometry Learning
    Zhang, Sen
    Zhang, Jing
    Tao, Dacheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (11) : 2553 - 2570
  • [23] INFORMATION-THEORETIC CRITERIA FOR THE DESIGN OF COMPRESSIVE SUBSPACE CLASSIFIERS
    Nokleby, Matthew
    Rodrigues, Miguel
    Calderbank, Robert
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [24] An Information-Theoretic Explanation for the Adversarial Fragility of AI Classifiers
    Xie, Hui
    Yi, Jirong
    Xu, Weiyu
    Mudumbai, Raghu
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 1977 - 1981
  • [25] Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning
    He, Haiyun
    Yan, Hanshu
    Tan, Vincent Y. F.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [26] Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning
    He, Haiyun
    Yan, Hanshu
    Tan, Vincent Y.F.
    Journal of Machine Learning Research, 2022, 23
  • [28] An information-theoretic treatment of quantum dichotomies
    Buscemi, Francesco
    Sutter, David
    Tomamichel, Marco
    QUANTUM, 2019, 3
  • [29] Information-Theoretic Analysis of Stability and Bias of Learning Algorithms
    Raginsky, Maxim
    Rakhlin, Alexander
    Tsao, Matthew
    Wu, Yihong
    Xu, Aolin
    2016 IEEE INFORMATION THEORY WORKSHOP (ITW), 2016,
  • [30] Information-Theoretic Interpretation of Quantum Formalism
    Feldmann, Michel
    FOUNDATIONS OF PHYSICS, 2023, 53 (03)