Quantum self-supervised learning

被引:17
|
作者
Jaderberg, B. [1 ]
Anderson, L. W. [1 ]
Xie, W. [2 ]
Albanie, S. [3 ]
Kiffner, M. [1 ,4 ]
Jaksch, D. [1 ,4 ,5 ]
机构
[1] Univ Oxford, Clarendon Lab, Parks Rd, Oxford OX1 3PU, England
[2] Univ Oxford, Dept Engn Sci, Visual Geometry Grp, Oxford, England
[3] Univ Cambridge, Dept Engn, Cambridge, England
[4] Natl Univ Singapore, Ctr Quantum Technol, 3 Sci Dr 2, Singapore 117543, Singapore
[5] Univ Hamburg, Inst Laserphys, D-22761 Hamburg, Germany
来源
QUANTUM SCIENCE AND TECHNOLOGY | 2022年 / 7卷 / 03期
基金
英国工程与自然科学研究理事会; 新加坡国家研究基金会;
关键词
variational quantum algorithms; quantum machine learning; self-supervised learning; deep learning; quantum neural networks; REPRESENTATION; ALGORITHM;
D O I
10.1088/2058-9565/ac6825
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human annotation. However, the staggering computational complexity of these methods is such that for state-of-the-art performance, classical hardware requirements represent a significant bottleneck to further progress. Here we take the first steps to understanding whether quantum neural networks (QNNs) could meet the demand for more powerful architectures and test its effectiveness in proof-of-principle hybrid experiments. Interestingly, we observe a numerical advantage for the learning of visual representations using small-scale QNN over equivalently structured classical networks, even when the quantum circuits are sampled with only 100 shots. Furthermore, we apply our best quantum model to classify unseen images on the ibmq_paris quantum computer and find that current noisy devices can already achieve equal accuracy to the equivalent classical model on downstream tasks.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Self-Supervised Learning: Generative or Contrastive
    Liu, Xiao
    Zhang, Fanjin
    Hou, Zhenyu
    Mian, Li
    Wang, Zhaoyu
    Zhang, Jing
    Tang, Jie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 857 - 876
  • [42] Self-Supervised Adversarial Imitation Learning
    Monteiro, Juarez
    Gavenski, Nathan
    Meneguzzi, Felipe
    Barros, Rodrigo C.
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [43] Self-Supervised Learning Across Domains
    Bucci, Silvia
    D'Innocente, Antonio
    Liao, Yujun
    Carlucci, Fabio Maria
    Caputo, Barbara
    Tommasi, Tatiana
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5516 - 5528
  • [44] Nonequilibrium thermodynamics of self-supervised learning
    Salazar, Domingos S. P.
    PHYSICS LETTERS A, 2021, 419
  • [45] Reverse Engineering Self-Supervised Learning
    Ben-Shaul, Ido
    Shwartz-Ziv, Ravid
    Galanti, Tomer
    Dekel, Shai
    LeCun, Yann
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [46] Self-supervised Learning for CT Deconvolution
    Sudhakar, Prasad
    Langoju, Rajesh
    Agrawal, Utkarsh
    Patil, Bhushan D.
    Narayanan, Ajay
    Chaugule, Vinay
    Amilneni, Vinod
    Cheerankal, Paul
    Das, Bipul
    MEDICAL IMAGING 2021: PHYSICS OF MEDICAL IMAGING, 2021, 11595
  • [47] Self-supervised learning for climate downscaling
    Singh, Karandeep
    Jeong, Chaeyoon
    Park, Sungwon
    Babur, Arjun N.
    Zeller, Elke
    Cha, Meeyoung
    2023 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING, BIGCOMP, 2023, : 13 - 17
  • [48] Self-Supervised Learning across the Spectrum
    Shenoy, Jayanth
    Zhang, Xingjian Davis
    Tao, Bill
    Mehrotra, Shlok
    Yang, Rem
    Zhao, Han
    Vasisht, Deepak
    REMOTE SENSING, 2024, 16 (18)
  • [49] Adversarial Masking for Self-Supervised Learning
    Shi, Yuge
    Siddharth, N.
    Torr, Philip H. S.
    Kosiorek, Adam R.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [50] Decoupled Self-supervised Learning for Graphs
    Xiao, Teng
    Chen, Zhengyu
    Guo, Zhimeng
    Zhuang, Zeyang
    Wang, Suhang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,