SwInt: A Non-Blocking Switch-Based Silicon Photonic Interposer Network for 2.5D Machine Learning Accelerators

被引:0
|
作者
Taheri, Ebadollah [1 ]
Mahdian, Mohammad Amin [1 ]
Pasricha, Sudeep [1 ]
Nikdast, Mahdi [1 ]
机构
[1] Colorado State Univ, Dept Elect & Comp Engn, Ft Collins, CO 80523 USA
基金
美国国家科学基金会;
关键词
Chiplets; Optical switches; Bandwidth; Optical waveguides; Energy efficiency; Silicon photonics; Computer architecture; 2.5D networks; ML accelerators; chiplet systems; energy-efficiency; interposer network; COMPUTING SYSTEMS; PERFORMANCE;
D O I
10.1109/JETCAS.2024.3429354
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The surging demand for machine learning (ML) applications has emphasized the pressing need for efficient ML accelerators capable of addressing the computational and energy demands of increasingly complex ML models. However, the conventional monolithic design of large-scale ML accelerators on a single chip often entails prohibitively high fabrication costs. To address this challenge, this paper proposes a 2.5D chiplet-based architecture based on a silicon photonic interposer, called SwInt, to enable high bandwidth, low latency, and energy-efficient data movement on the interposer, for ML applications. Existing silicon photonic interposer implementations suffer from high power consumption attributed to their inefficient network designs, primarily relying on bus-based communication. Bus-based communication is not scalable, as it suffers from high power consumption of the optical laser due to cumulative losses on the readers and writers when the bandwidth per waveguide (i.e., wavelength division multiplexing degree) increases or the number of processing elements in ML accelerators scales up. SwInt incorporates a novel switch-based network designed using Mach-Zehnder Interferometer (MZI)-based switch cells for offering scalable interposer communication and reducing power consumption. The designed switch architecture avoids blocking using an efficient design, while minimizing the number of stages to offer a low-loss switch. Furthermore, the MZI switch cells are designed with a dividing state, enabling energy-efficient broadcast communication over the interposer and supporting broadcasting demand in ML accelerators. Additionally, we optimized and fabricated silicon photonic devices, Microring Resonators (MRRs) and MZIs, which are integral components of our network architecture. Our analysis shows that SwInt achieves, on average, 62% and 64% improvement in power consumption under, respectively, unicast and broadcast communication, resulting in 59.7% energy-efficiency improvement compared to the state-of-the-art silicon photonic interposers specifically designed for ML accelerators.
引用
收藏
页码:520 / 533
页数:14
相关论文
共 34 条
  • [31] 140 Gb/s WDM Data Routing in a Lossless Strictly Non-Blocking SOA-Based Photonic Integrated 8x8 Space Switch
    Feyisa, D. W.
    Shi, B.
    Smalbrugge, B.
    Williams, K. A.
    Calabretta, N.
    Stabile, R.
    2021 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXPOSITION (OFC), 2021,
  • [32] Low Insertion Loss and Non-Blocking Microring-Based Optical Router for 3D Optical Network-on-Chip
    Guo, Pengxing
    Hou, Weigang
    Guo, Lei
    Yang, Qiang
    Ge, Yifan
    Liang, Hang
    IEEE PHOTONICS JOURNAL, 2018, 10 (01):
  • [33] An RDL Modeling and Thermo-Mechanical Simulation Method of 2.5D/3D Advanced Package Considering the Layout Impact Based on Machine Learning
    Wu, Xiaodong
    Wang, Zhizhen
    Ma, Shenglin
    Chu, Xianglong
    Li, Chunlei
    Wang, Wei
    Jin, Yufeng
    Wu, Daowei
    MICROMACHINES, 2023, 14 (08)
  • [34] A tree-based machine learning surrogate model for predicting off-axis tensile mechanical properties of 2.5D woven composites at high temperatures
    Zhang, Chao
    Bian, Zhouyang
    Bui, Tinh Quoc
    Curiel-Sosa, Jose
    COMPOSITE STRUCTURES, 2025, 360