Transfer Learning for Quantum Classifiers: An Information-Theoretic Generalization Analysis

被引:2
|
作者
Jose, Sharu Theresa [1 ]
Simeone, Osvaldo [2 ]
机构
[1] Univ Birmingham, Dept Comp Sci, Birmingham, England
[2] Kings Coll London, Dept Engn, London, England
基金
欧洲研究理事会; 英国工程与自然科学研究理事会;
关键词
D O I
10.1109/ITW55543.2023.10160236
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A key component of a quantum machine learning model operating on classical inputs is the design of an embedding circuit mapping inputs to a quantum state. This paper studies a transfer learning setting in which classical-to-quantum embedding is carried out by an arbitrary parametric quantum circuit that is pre-trained based on data from a source task. At run time, a binary quantum classifier of the embedding is optimized based on data from the target task of interest. The average excess risk, i.e., the optimality gap, of the resulting classifier depends on how (dis)similar the source and target tasks are. We introduce a new measure of (dis)similarity between the binary quantum classification tasks via the trace distances. An upper bound on the optimality gap is derived in terms of the proposed task (dis)similarity measure, two Renyi mutual information terms between classical input and quantum embedding under source and target tasks, as well as a measure of complexity of the combined space of quantum embeddings and classifiers under the source task. The theoretical results are validated on a simple binary classification example.
引用
收藏
页码:532 / 537
页数:6
相关论文
共 50 条
  • [31] Information-theoretic characterization of quantum chaos
    Schack, R
    Caves, CM
    PHYSICAL REVIEW E, 1996, 53 (04): : 3257 - 3270
  • [32] INFORMATION-THEORETIC LIMITS TO QUANTUM CRYPTOGRAPHY
    BARNETT, SM
    PHOENIX, SJD
    PHYSICAL REVIEW A, 1993, 48 (01): : R5 - R8
  • [33] Information-Theoretic Interpretation of Quantum Formalism
    Michel Feldmann
    Foundations of Physics, 2023, 53
  • [34] Information-theoretic aspects of quantum copying
    Cerf, NJ
    QUANTUM COMPUTING AND QUANTUM COMMUNICATIONS, 1999, 1509 : 218 - 234
  • [35] Stochastic chaining and strengthened information-theoretic generalization bounds
    Zhou, Ruida
    Tian, Chao
    Liu, Tie
    JOURNAL OF THE FRANKLIN INSTITUTE, 2023, 360 (06) : 4114 - 4134
  • [36] An Information-Theoretic View of Generalization via Wasserstein Distance
    Wang, Hao
    Diaz, Mario
    Santos Filho, Jose Candido S.
    Calmon, Flavio P.
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 577 - 581
  • [37] Information-Theoretic Characterizations of Generalization Error for the Gibbs Algorithm
    Aminian, Gholamali
    Bu, Yuheng
    Toni, Laura
    Rodrigues, Miguel R. D.
    Wornell, Gregory W.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (01) : 632 - 655
  • [38] Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence
    Jose, Sharu Theresa
    Simeone, Osvaldo
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1461 - 1465
  • [39] Information-theoretic distance measures and a generalization of stochastic resonance
    Robinson, JWC
    Asraf, DE
    Bulsara, AR
    Inchiosa, ME
    PHYSICAL REVIEW LETTERS, 1998, 81 (14) : 2850 - 2853
  • [40] Information-theoretic analysis of information hiding
    Moulin, P
    O'Sullivan, JA
    2000 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2000, : 19 - 19