共 22 条
Flux: Decoupled Auto-Scaling for Heterogeneous Query Workload in Alibaba AnalyticDB
被引:0
|作者:
Li, Wei
[1
]
Zhang, Jiachi
[1
]
Yin, Ye
[1
]
Li, Yan
[1
]
Zhu, Zhanyang
[1
]
Zhou, Wenchao
[1
]
Lin, Liang
[1
]
Li, Feifei
[1
]
机构:
[1] Alibaba Grp, Hangzhou, Peoples R China
来源:
关键词:
cloud data warehouse;
auto-scaling;
heterogeneous workloads;
MANAGEMENT;
D O I:
10.1145/3626246.3653381
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
Modern cloud data warehouses are integral to processing heterogeneous query workloads, which range from quick online transactions to intensive ad-hoc queries and extract, transform, load (ETL) processes. The synchronization of heterogeneous workloads, particularly the blend of short and long-running queries, often degrades performance due to intricate concurrency controls and cooperative multi-tasking execution models. Additionally, the auto-scaling mechanisms for mixed workloads can lead to spikes in demand and underutilized resources, impacting both performance and cost-efficiency. This paper introduces the Flux, a cloud-native workload auto-scaling platform designed for Alibaba AnalyticDB, which implements a pioneering decoupled auto-scaling architecture. By separating the scaling mechanisms for short and long-running queries, Flux not only resolves performance bottlenecks but also harnesses the elasticity of serverless container instances for ondemand resource provisioning. Our extensive evaluations demonstrate Flux's superiority over traditional scaling methods, with up to a 75% reduction in query response time (RT), a 19.0% increase in resource utilization ratio, and a 77.8% decrease in cost overhead.
引用
下载
收藏
页码:255 / 268
页数:14
相关论文