Kora: A Cloud-Native Event Streaming Platform For Kafka

被引:0
|
作者
Povzner, Anna [1 ]
Mahajan, Prince [1 ]
Gustafson, Jason [1 ]
Rao, Jun [1 ]
Juma, Ismael [1 ]
Min, Feng [1 ]
Sridharan, Shriram [1 ]
Bhatia, Nikhil [1 ]
Attaluri, Gopi [1 ]
Chandra, Adithya [1 ]
Kozlovski, Stanislav [1 ]
Sivaram, Rajini [1 ]
Bradstreet, Lucas [1 ]
Barrett, Bob [1 ]
Shah, Dhruvil [1 ]
Jacot, David [1 ]
Arthur, David [1 ]
Chawla, Manveer [1 ]
Dagostino, Ron [1 ]
Mccabe, Colin [1 ]
Obili, Manikumar Reddy [1 ]
Prakasam, Kowshik [1 ]
Sancio, Jose Garcia [1 ]
Singh, Vikas [1 ]
Nikhil, Alok [1 ]
Gupta, Kamal [1 ]
机构
[1] Confluent Inc, Mountain View, CA 94041 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
关键词
D O I
10.14778/3611540.3611567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces Kora, the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.
引用
收藏
页码:3822 / 3834
页数:13
相关论文
共 50 条
  • [1] StreamOps: Cloud-Native Runtime Management for Streaming Services in ByteDance
    Mao, Yancan
    Chen, Zhanghao
    Zhang, Yifan
    Wang, Meng
    Fang, Yong
    Zhang, Guanghui
    Shi, Rui
    Ma, Richard T. B.
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (12): : 3501 - 3514
  • [2] A Cloud-Native Platform for 5G Experimentation
    Vazquez-Rodriguez, Alvaro
    Giraldo-Rodriguez, Carlos
    Chaves-Dieguez, David
    2022 IEEE INTERNATIONAL BLACK SEA CONFERENCE ON COMMUNICATIONS AND NETWORKING (BLACKSEACOM), 2022, : 60 - 64
  • [3] Cloud-Native 5G Service Delivery Platform
    Haensge, Kay
    Trossen, Dirk
    Robitzsch, Sebastian
    Boniface, Michael
    Phillips, Stephen
    2019 IEEE CONFERENCE ON NETWORK FUNCTION VIRTUALIZATION AND SOFTWARE DEFINED NETWORKS (IEEE NFV-SDN), 2019,
  • [4] Cloud-Native, Event-Based Programming for Mobile Applications
    Baldini, Ioana
    Castro, Paul
    Cheng, Perry
    Fink, Stephen
    Ishakian, Vatche
    Mitchell, Nick
    Muthusamy, Vinod
    Rabbah, Rodric
    Suter, Philippe
    2016 IEEE/ACM INTERNATIONAL CONFERENCE ON MOBILE SOFTWARE ENGINEERING AND SYSTEMS (MOBILESOFT 2016), 2016, : 287 - 288
  • [5] Full-stack vulnerability analysis of the cloud-native platform
    Zeng, Qingyang
    Kavousi, Mohammad
    Luo, Yinhong
    Jin, Ling
    Chen, Yan
    COMPUTERS & SECURITY, 2023, 129
  • [6] Cloud-Native Applications and Services
    Kratzke, Nane
    FUTURE INTERNET, 2022, 14 (12)
  • [7] Survey on Cloud-native Databases
    Dong H.-W.
    Zhang C.
    Li G.-L.
    Feng J.-H.
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (02): : 899 - 926
  • [8] DSCOPE: A Cloud-Native Internet Telescope
    Pauley, Eric
    Barford, Paul
    McDaniel, Patrick
    PROCEEDINGS OF THE 32ND USENIX SECURITY SYMPOSIUM, 2023, : 5989 - 6006
  • [9] Cloud-Native Transactions and Analytics in SingleStore
    Prout, Adam
    Wang, Szu-Po
    Victor, Joseph
    Sun, Zhou
    Li, Yongzhu
    Chen, Jack
    Bergeron, Evan
    Hanson, Eric
    Walzer, Robert
    Gomes, Rodrigo
    Shamgunov, Nikita
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 2340 - 2352
  • [10] Forensic analysis of cloud-native artifacts
    Roussev, Vassil
    McCulley, Shane
    DIGITAL INVESTIGATION, 2016, 16 : S104 - S113