Attention-enhanced reservoir computing

被引:0
|
作者
Koester, Felix [1 ]
Kanno, Kazutaka [1 ]
Ohkubo, Jun [1 ]
Uchida, Atsushi [1 ]
机构
[1] Saitama Univ, Dept Informat & Comp Sci, 255 Shimo Okubo,Sakura Ku, Saitama, Saitama 3388570, Japan
来源
PHYSICAL REVIEW APPLIED | 2024年 / 22卷 / 01期
关键词
CHAOS;
D O I
10.1103/PhysRevApplied.22.014039
中图分类号
O59 [应用物理学];
学科分类号
摘要
Photonic reservoir computing has been successfully utilized in time-series prediction as the need for hardware implementations has increased. Prediction of chaotic time series remains a significant challenge, an area where the conventional reservoir computing framework encounters limitations of prediction accuracy. We introduce an attention mechanism to the reservoir computing model in the output stage. This attention layer is designed to prioritize distinct features and temporal sequences, thereby substantially enhancing the prediction accuracy. Our results show that a photonic reservoir computer enhanced with the attention mechanism exhibits improved prediction capabilities for smaller reservoirs. These advancements highlight the transformative possibilities of reservoir computing for practical applications where accurate prediction of chaotic time series is crucial.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] ATTENTION-ENHANCED SENSORIMOTOR OBJECT RECOGNITION
    Thermos, Spyridon
    Papadopoulos, Georgios Th.
    Daras, Petros
    Potamianos, Gerasimos
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 336 - 340
  • [2] Evaluation and analysis of visual perception using attention-enhanced computation in multimedia affective computing
    Wang, Jingyi
    [J]. FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [3] APLNet: Attention-enhanced progressive learning network
    Zhang, Hui
    Kang, Danqing
    He, Haibo
    Wang, Fei-Yue
    [J]. NEUROCOMPUTING, 2020, 371 : 166 - 176
  • [4] Attention-Enhanced Gradual Machine Learning for Entity Resolution
    Zhong, Ping
    Li, Zhanhuai
    Chen, Qun
    Hou, Boyi
    [J]. IEEE INTELLIGENT SYSTEMS, 2021, 36 (06) : 71 - 79
  • [5] Attention-Enhanced CNN for Chinese Calligraphy Styles Classification
    Zhang, Jiulong
    Yu, Wenhang
    Wang, Zhixiao
    Li, Junhuai
    Pan, Zhigeng
    [J]. 2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 352 - 358
  • [6] Predicting galaxy morphology using attention-enhanced ResNets
    Gupta, Akshit
    Kaur, Kanwarpreet
    Jindal, Neeru
    [J]. EARTH SCIENCE INFORMATICS, 2024,
  • [7] Attention-Enhanced Multimodal Learning for Conceptual Design Evaluations
    Song, Binyang
    Miller, Scarlett
    Ahmed, Faez
    [J]. JOURNAL OF MECHANICAL DESIGN, 2023, 145 (04)
  • [8] Adaptive Attention-Enhanced Yolo for Wall Crack Detection
    Chen, Ying
    Wu, Wangyu
    Li, Junxia
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [9] A robust attention-enhanced network with transformer for visual tracking
    Fengwei Gu
    Jun Lu
    Chengtao Cai
    [J]. Multimedia Tools and Applications, 2023, 82 : 40761 - 40782
  • [10] Attention-enhanced neural network models for turbulence simulation
    Peng, Wenhui
    Yuan, Zelong
    Wang, Jianchun
    [J]. PHYSICS OF FLUIDS, 2022, 34 (02)