Practical Cloud-Edge Scheduling for Large-Scale Crowdsourced Live Streaming

被引:2
|
作者
Zhang, Ruixiao [1 ,2 ]
Yang, Changpeng [5 ]
Wang, Xiaochan [3 ]
Huang, Tianchi [4 ]
Wu, Chenglei [4 ]
Liu, Jiangchuan [6 ]
Sun, Lifeng [4 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100190, Peoples R China
[2] Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Tsinghua Univ, Dept Comp Sci & Technol, BNRist, Beijing 100190, Peoples R China
[4] Tsinghua Univ, Minist Educ, Dept Comp Sci & Technol, Key Lab Pervas Comp, Beijing 100064, Peoples R China
[5] Dept Innovat Algorithm, Huawei Cloud, Minist Educ, Key Lab Pervas Comp, Shenzhen 518129, Peoples R China
[6] Simon Fraser Univ, Sch Comp Sci, Vancouver, BC V5A 1S6, Canada
关键词
Costs; Quality of service; Bandwidth; Servers; Optimization; Computer science; Systematics; Cloud edge computing; content delivery; Index Terms; live streaming; resource scheduling; traffic engineering;
D O I
10.1109/TPDS.2023.3267731
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Even though conventional wisdom claims that in order to improve viewer engagement, the cloud-edge providers should serve the viewers with the nearest edge nodes, however, we show that doing this for crowdsourced live streaming (CLS) services can introduce significant costs inefficiency. In this paper, we first carry out large-scale measurement analysis by using the real-world service data from Huawei Cloud, a representative cloud-edge provider in China. We observe that the massive number of channels has proposed great burdens to the operating expenditure of the cloud-edge providers, and most importantly, unbalanced viewer distribution makes the edge nodes suffer significant costs inefficiency. To tackle the above concerns, we propose AggCast, a novel CLS scheduling framework to optimize the edge node utilization for the cloud-edge provider. The core idea of AggCast is to aggregate some viewers that are initially scattered on different regions, and assign them to fewer pre-selected nodes, thereby reducing bandwidth costs. In particular, by integrating the useful insights obtained from our large-scale measurement, AggCast can not only ensure that quality of experience (QoS) does not suffer degradation, but also satisfy the systematic requirements of CLS services. AggCast has been A/B tested and fully deployed. The online and trace-driven experiments show that, compared to the most prevalent method, AggCast saves over 16.3% back-to-source (BTS) bandwidth costs while significantly improving QoS (startup latency, stall frequency and stall time are reduced over 12.3%, 4.57% and 3.91%, respectively).
引用
收藏
页码:2055 / 2071
页数:17
相关论文
共 50 条
  • [1] AggCast: Practical Cost-effective Scheduling for Large-scale Cloud-edge Crowdsourced Live Streaming
    Zhang, Rui-Xiao
    Yang, Changpeng
    Wang, Xiaochan
    Huang, Tianchi
    Wu, Chenglei
    Liu, Jiangchuan
    Sun, Lifeng
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3026 - 3034
  • [2] Parallel Scheduling of Large-Scale Tasks for Industrial Cloud-Edge Collaboration
    Laili, Yuanjun
    Guo, Fuqiang
    Ren, Lei
    Li, Xiang
    Li, Yulin
    Zhang, Lin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) : 3231 - 3242
  • [3] Adaptive cloud resource allocation for large-scale crowdsourced multimedia live streaming services
    Kim, Jeong-Hoon
    Kim, Sun-Hyun
    Bak, Charn-Doh
    Han, Seung-Jae
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3233 - 3257
  • [4] Adaptive cloud resource allocation for large-scale crowdsourced multimedia live streaming services
    Kim, Jeong-Hoon
    Kim, Sun-Hyun
    Bak, Charn-Doh
    Han, Seung-Jae
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3233 - 3257
  • [5] A large-scale holistic measurement of crowdsourced edge cloud platform
    Yicheng Feng
    Shihao Shen
    Mengwei Xu
    Cheng Zhang
    Xin Wang
    Xiaofei Wang
    Wenyu Wang
    Victor C. M. Leung
    [J]. World Wide Web, 2023, 26 : 3561 - 3584
  • [6] A large-scale holistic measurement of crowdsourced edge cloud platform
    Feng, Yicheng
    Shen, Shihao
    Xu, Mengwei
    Zhang, Cheng
    Wang, Xin
    Wang, Xiaofei
    Wang, Wenyu
    Leung, Victor C. M.
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 3561 - 3584
  • [7] Cloud-Edge Hybrid Computing Architecture for Large-Scale Scientific Facilities Augmented with an Intelligent Scheduling System
    Ye, Jing
    Wang, Chunpeng
    Chen, Jige
    Wan, Rongzheng
    Li, Xiaoyun
    Sepe, Alessandro
    Tai, Renzhong
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [8] Large-scale Video Analytics with Cloud-Edge Collaborative Continuous Learning
    Nan, Ya
    Jiang, Shiqi
    Li, Mo
    [J]. ACM TRANSACTIONS ON SENSOR NETWORKS, 2024, 20 (01)
  • [9] Crowdsourced Live Streaming over the Cloud
    Chen, Fei
    Zhang, Cong
    Wang, Feng
    Liu, Jiangchuan
    [J]. 2015 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (INFOCOM), 2015,
  • [10] Cloud-Edge Cooperative MPC for Large-Scale Complex Systems With Input Nonlinearity
    Ma, Yaling
    Dai, Li
    Yang, Huan
    Zhao, Junxiao
    Gao, Runze
    Xia, Yuanqing
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024,