Quantum self-supervised learning

被引:17
|
作者
Jaderberg, B. [1 ]
Anderson, L. W. [1 ]
Xie, W. [2 ]
Albanie, S. [3 ]
Kiffner, M. [1 ,4 ]
Jaksch, D. [1 ,4 ,5 ]
机构
[1] Univ Oxford, Clarendon Lab, Parks Rd, Oxford OX1 3PU, England
[2] Univ Oxford, Dept Engn Sci, Visual Geometry Grp, Oxford, England
[3] Univ Cambridge, Dept Engn, Cambridge, England
[4] Natl Univ Singapore, Ctr Quantum Technol, 3 Sci Dr 2, Singapore 117543, Singapore
[5] Univ Hamburg, Inst Laserphys, D-22761 Hamburg, Germany
来源
QUANTUM SCIENCE AND TECHNOLOGY | 2022年 / 7卷 / 03期
基金
英国工程与自然科学研究理事会; 新加坡国家研究基金会;
关键词
variational quantum algorithms; quantum machine learning; self-supervised learning; deep learning; quantum neural networks; REPRESENTATION; ALGORITHM;
D O I
10.1088/2058-9565/ac6825
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human annotation. However, the staggering computational complexity of these methods is such that for state-of-the-art performance, classical hardware requirements represent a significant bottleneck to further progress. Here we take the first steps to understanding whether quantum neural networks (QNNs) could meet the demand for more powerful architectures and test its effectiveness in proof-of-principle hybrid experiments. Interestingly, we observe a numerical advantage for the learning of visual representations using small-scale QNN over equivalently structured classical networks, even when the quantum circuits are sampled with only 100 shots. Furthermore, we apply our best quantum model to classify unseen images on the ibmq_paris quantum computer and find that current noisy devices can already achieve equal accuracy to the equivalent classical model on downstream tasks.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Self-Supervised Learning in Remote Sensing
    Wang, Yi
    Albrecht, Conrad M.
    Ait Ali Braham, Nassim
    Mou, Lichao
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2022, 10 (04) : 213 - 247
  • [22] Whitening for Self-Supervised Representation Learning
    Ermolov, Aleksandr
    Siarohin, Aliaksandr
    Sangineto, Enver
    Sebe, Nicu
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [23] Self-supervised Graph Learning for Recommendation
    Wu, Jiancan
    Wang, Xiang
    Feng, Fuli
    He, Xiangnan
    Chen, Liang
    Lian, Jianxun
    Xie, Xing
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 726 - 735
  • [24] COMBINING SELF-SUPERVISED AND SUPERVISED LEARNING WITH NOISY LABELS
    Zhang, Yongqi
    Zhang, Hui
    Yao, Quanming
    Wan, Jun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 605 - 609
  • [25] Self-Supervised Learning for Videos: A Survey
    Schiappa, Madeline C.
    Rawat, Yogesh S.
    Shah, Mubarak
    ACM COMPUTING SURVEYS, 2023, 55 (13S)
  • [26] Self-supervised learning in medicine and healthcare
    Krishnan, Rayan
    Rajpurkar, Pranav
    Topol, Eric J.
    NATURE BIOMEDICAL ENGINEERING, 2022, 6 (12) : 1346 - 1352
  • [27] Graph Adversarial Self-Supervised Learning
    Yang, Longqi
    Zhang, Liangliang
    Yang, Wenjing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [28] Biased Self-supervised learning for ASR
    Kreyssig, Florian L.
    Shi, Yangyang
    Guo, Jinxi
    Sari, Leda
    Mohamed, Abdelrahman
    Woodland, Philip C.
    INTERSPEECH 2023, 2023, : 4948 - 4952
  • [29] The Challenges of Continuous Self-Supervised Learning
    Purushwalkam, Senthil
    Morgado, Pedro
    Gupta, Abhinav
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 702 - 721
  • [30] Self-Supervised Learning for User Localization
    Dash, Ankan
    Gu, Jingyi
    Wang, Guiling
    Ansari, Nirwan
    2024 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2024, : 886 - 890