Transfer Learning for Quantum Classifiers: An Information-Theoretic Generalization Analysis

被引:2
|
作者
Jose, Sharu Theresa [1 ]
Simeone, Osvaldo [2 ]
机构
[1] Univ Birmingham, Dept Comp Sci, Birmingham, England
[2] Kings Coll London, Dept Engn, London, England
基金
欧洲研究理事会; 英国工程与自然科学研究理事会;
关键词
D O I
10.1109/ITW55543.2023.10160236
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A key component of a quantum machine learning model operating on classical inputs is the design of an embedding circuit mapping inputs to a quantum state. This paper studies a transfer learning setting in which classical-to-quantum embedding is carried out by an arbitrary parametric quantum circuit that is pre-trained based on data from a source task. At run time, a binary quantum classifier of the embedding is optimized based on data from the target task of interest. The average excess risk, i.e., the optimality gap, of the resulting classifier depends on how (dis)similar the source and target tasks are. We introduce a new measure of (dis)similarity between the binary quantum classification tasks via the trace distances. An upper bound on the optimality gap is derived in terms of the proposed task (dis)similarity measure, two Renyi mutual information terms between classical input and quantum embedding under source and target tasks, as well as a measure of complexity of the combined space of quantum embeddings and classifiers under the source task. The theoretical results are validated on a simple binary classification example.
引用
收藏
页码:532 / 537
页数:6
相关论文
共 50 条
  • [41] Information-theoretic analysis of information hiding
    Moulin, P
    O'Sullivan, JA
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2003, 49 (03) : 563 - 593
  • [42] Information-theoretic analysis of watermarking
    Moulin, P
    O'Sullivan, JA
    2000 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS, VOLS I-VI, 2000, : 3630 - 3633
  • [43] Reinforcement Learning with Information-Theoretic Actuation
    Catt, Elliot
    Hutter, Marcus
    Veness, Joel
    ARTIFICIAL GENERAL INTELLIGENCE, AGI 2022, 2023, 13539 : 188 - 198
  • [44] An Information-Theoretic Analysis of Deduplication
    Niesen, Urs
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (09) : 5688 - 5704
  • [45] An Information-Theoretic Analysis of Deduplication
    Niesen, Urs
    2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017, : 1738 - 1742
  • [46] Information-theoretic selection of classifiers for building multiple classifier systems
    Kang, HJ
    Choo, M
    ADVANCES IN INTELLIGENT COMPUTING, PT 1, PROCEEDINGS, 2005, 3644 : 909 - 918
  • [47] An Information-Theoretic Framework for Deep Learning
    Jeon, Hong Jun
    Van Roy, Benjamin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [48] Information-theoretic approach to interactive learning
    Still, S.
    EPL, 2009, 85 (02)
  • [49] An information-theoretic measure to evaluate data partitions in multiple classifiers
    Dara, RA
    Makrehchi, M
    Kamel, M
    2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 4826 - 4831
  • [50] Mathematical Analysis on Information-Theoretic Metric Learning With Application to Supervised Learning
    Choi, Jooyeon
    Min, Chohong
    Lee, Byungjoon
    IEEE ACCESS, 2019, 7 : 121998 - 122005