Enhancing the expressivity of quantum neural networks with residual connections

被引:0
|
作者
Wen, Jingwei [1 ]
Huang, Zhiguo [1 ]
Cai, Dunbo [1 ]
Qian, Ling [1 ]
机构
[1] China Mobile Suzhou Software Technol Co Ltd, Suzhou 215163, Peoples R China
来源
COMMUNICATIONS PHYSICS | 2024年 / 7卷 / 01期
关键词
PRINCIPLE;
D O I
10.1038/s42005-024-01719-1
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In noisy intermediate-scale quantum era, the research on the combination of artificial intelligence and quantum computing has been greatly developed. Here we propose a quantum circuit-based algorithm to implement quantum residual neural networks, where the residual connection channels are constructed by introducing auxiliary qubits to data-encoding and trainable blocks in quantum neural networks. We prove that when this particular network architecture is applied to a l-layer data-encoding, the number of frequency generation forms extends from one, namely the difference of the sum of generator eigenvalues, to O(l2)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{{{{{{\mathcal{O}}}}}}}}({l}<^>{2})$$\end{document}, and the flexibility in adjusting Fourier coefficients can also be improved. It indicates that residual encoding can achieve better spectral richness and enhance the expressivity of various parameterized quantum circuits. Extensive numerical demonstrations in regression tasks and image classification are offered. Our work lays foundation for the complete quantum implementation of classical residual neural networks and offers a quantum feature map strategy for quantum machine learning. The authors introduce a quantum circuit-based algorithm to implement quantum residual neural networks by incorporating auxiliary qubits in the data-encoding and trainable blocks, which leads to an improved expressivity of parameterized quantum circuits. The results are supported by extensive numerical demonstrations and theoretical analysis.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Expressivity of quantum neural networks
    Wu, Yadong
    Yao, Juan
    Zhang, Pengfei
    Zhai, Hui
    [J]. PHYSICAL REVIEW RESEARCH, 2021, 3 (03):
  • [2] The expressivity of classical and quantum neural networks on entanglement entropy
    Wu, Chih-Hung
    Yen, Ching-Che
    [J]. EUROPEAN PHYSICAL JOURNAL C, 2024, 84 (02):
  • [3] The expressivity of classical and quantum neural networks on entanglement entropy
    Chih-Hung Wu
    Ching-Che Yen
    [J]. The European Physical Journal C, 84
  • [4] Randomness-Enhanced Expressivity of Quantum Neural Networks
    Wu, Yadong
    Yao, Juan
    Zhang, Pengfei
    Li, Xiaopeng
    [J]. PHYSICAL REVIEW LETTERS, 2024, 132 (01)
  • [5] Improving Expressivity of Graph Neural Networks
    Purgal, Stanislaw J.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] On the Expressivity of Neural Networks for Deep Reinforcement Learning
    Dong, Kefan
    Luo, Yuping
    Yu, Tianhe
    Finn, Chelsea
    Ma, Tengyu
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [7] On the Expressivity of Neural Networks for Deep Reinforcement Learning
    Dong, Kefan
    Luo, Yuping
    Yu, Tianhe
    Finn, Chelsea
    Ma, Tengyu
    [J]. 25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [8] Improved Expressivity Through Dendritic Neural Networks
    Wu, Xundong
    Liu, Xiangwen
    Li, Wei
    Wu, Qing
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [9] Fine-grained Expressivity of Graph Neural Networks
    Boeker, Jan
    Levie, Ron
    Huang, Ningyuan
    Villar, Soledad
    Morris, Christopher
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [10] DYNAMIC CONNECTIONS IN NEURAL NETWORKS
    FELDMAN, JA
    [J]. BIOLOGICAL CYBERNETICS, 1982, 46 (01) : 27 - 39