NB-Cache: Non-Blocking In-Network Caching for High-Performance Content Routers

被引:1
|
作者
Pan, Tian [1 ]
Lin, Xingchen [1 ]
Song, Enge [1 ]
Xu, Cheng [1 ]
Zhang, Jiao [1 ]
Li, Hao [2 ]
Lv, Jianhui [3 ]
Huang, Tao [1 ]
Liu, Bin [4 ]
Zhang, Beichuan [5 ]
机构
[1] Beijing Univ Posts & Telecommun BUPT, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] Xi An Jiao Tong Univ, Dept Comp Sci & Technol, Xian 710049, Peoples R China
[3] Tsinghua Univ, Int Grad Sch Shenzhen, Shenzhen 518057, Peoples R China
[4] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[5] Univ Arizona, Dept Comp Sci, Tucson, AZ 85721 USA
基金
中国国家自然科学基金;
关键词
Pipelines; Load modeling; Data models; Throughput; Queueing analysis; Prototypes; Markov processes; ICN; content router; bottleneck bypassing; non-blocking I; O; Bloom filter; N-queue bypass model; TANDEM QUEUE;
D O I
10.1109/TNET.2021.3083599
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Information-Centric Networking (ICN) provides scalable and efficient content distribution at the Internet scale due to in-network caching and native multicast. To support these features, a content router needs high performance at its data plane, which consists of three forwarding steps: checking the Content Store (CS), then the Pending Interest Table (PIT), and finally the Forwarding Information Base (FIB). In this work, we build an analytical model of the router and identify that CS is the actual bottleneck. Then, we propose a novel mechanism called "NB-Cache" to address CS's performance issue from a network-wide point of view. In NB-Cache, when packets arrive at a router whose CS is fully loaded, instead of being blocked and waiting for the CS, these packets are forwarded to the next-hop router, whose CS may not be fully loaded. This approach essentially utilizes Content Stores of all the routers along the forwarding path in parallel rather than checking each CS sequentially. NB-Cache follows a design pattern of on-demand load balancing and can be formulated into a non-trivial N-queue bypass model. We use the Markov chain to establish its theoretical base and find an algorithm for automated transition rate matrix generation. Experiments show significant improvement of data plane performance: 70% reduction in round-trip time (RTT) and 130% increase in throughput. NB-Cache decouples the fast packet forwarding from the slower content retrieval thus substantially reducing CS's heavy dependency on fast but expensive memory.
引用
收藏
页码:1976 / 1989
页数:14
相关论文
共 50 条
  • [31] Distance associativity for high-performance energy-efficient non-uniform cache architectures
    Chishti, Z
    Powell, MD
    Vijaykumar, TN
    [J]. 36TH INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, PROCEEDINGS, 2003, : 55 - 66
  • [32] A new non-blocking counter-based coordinated checkpointing algorithm as a migration tool in a high performance dynamic Grid scheduler
    El-Sayed, GA
    Greensheids, IR
    [J]. PDPTA '04: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-3, 2004, : 217 - 223
  • [33] Novel Method for Verification and Performance Evaluation of a Non-Blocking Level-1 Instruction Cache designed for Out-of-Order RISC-V Superscaler Processor on FPGA
    Desalphine, Vivian
    Dashora, Somya
    Mali, Laxita
    Suhas, K.
    Raveendran, Aneesh
    Selvakumar, David
    [J]. 2020 24TH INTERNATIONAL SYMPOSIUM ON VLSI DESIGN AND TEST (VDAT), 2020,
  • [34] Non-blocking Electro-optic Network-on-Chip Router for High-throughput and Low-power Many-core Systems
    Ben Ahmed, Achraf
    Okuyama, Yuichi
    Ben Abdallah, Abderazek
    [J]. 2015 WORLD CONGRESS ON INFORMATION TECHNOLOGY AND COMPUTER APPLICATIONS (WCITCA), 2015,
  • [35] High-Performance Video Content Recognition with Long-term Recurrent Convolutional Network for FPGA
    Zhang, Xiaofan
    Liu, Xinheng
    Ramachandran, Anand
    Zhuge, Chuanhao
    Tang, Shibin
    Ouyang, Peng
    Cheng, Zuofu
    Rupnow, Kyle
    Chen, Deming
    [J]. 2017 27TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2017,
  • [36] REVIEW OF NON-COVENTIONAL PROCESSING OF HIGH-PERFORMANCE OF NB BASED SUPERCONDUCTORS USING DUCTILE POWDERS
    FONER, S
    [J]. JOURNAL OF METALS, 1988, 40 (11): : 110 - 110
  • [37] High-Performance and Robust Binarized Neural Network Accelerator Based on Modified Content-Addressable Memory
    Choi, Sureum
    Jeon, Youngjun
    Seo, Yeongkyo
    [J]. ELECTRONICS, 2022, 11 (17)
  • [38] Optimal Combinations of SCM Characteristics and Non-volatile Cache Algorithms for High-Performance SCM/NAND Flash Hybrid SSD
    Yamada, Tomoaki
    Matsui, Chihiro
    Takeuchi, Ken
    [J]. 2016 IEEE SILICON NANOELECTRONICS WORKSHOP (SNW), 2016, : 88 - 89
  • [39] Decentralized media streaming infrastructure (DeMSI): An adaptive and high-performance peer-to-peer content delivery network
    Yim, Alan Kin Wah
    Buyya, Rajkumar
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2006, 52 (12) : 737 - 772
  • [40] Interconnected Bi5Nb3O15@CNTs network as high-performance anode materials of Li-ion battery
    Li, Xue-Zhong
    Zhang, Nan
    Wu, Yu-Rong
    Lai, Qin-Zhi
    Zhu, Yan-Rong
    Zhang, Jun-Hong
    Cui, Ping
    Yi, Ting-Feng
    [J]. RARE METALS, 2022, 41 (10) : 3401 - 3411