Effective Multi-stream Joining in Apache Samza Framework

被引：10

作者：

Zhuang, Zhenyun ^{[1
]}

Feng, Tao ^{[1
]}

Pan, Yi ^{[1
]}

Ramachandra, Haricharan ^{[1
]}

Sridharan, Badri ^{[1
]}

机构：

[1] LinkedIn Corp, 2029 Stierlin Court, Mountain View, CA 94043 USA

来源：

2016 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2016 | 2016年

关键词：

Multi-stream joining; Samza; Stream processing; Big Data;

D O I：

10.1109/BigDataCongress.2016.41

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Increasing adoption of Big Data in business environments have driven the needs of stream joining in realtime fashion. Multi-stream joining is an important stream processing type in todays Internet companies, and it has been used to generate higher-quality data in business pipelines. Multi-stream joining can be performed in two models: ( 1) All-In-One (AIO) Joining and (2) Step-By-Step (SBS) Joining. Both models have advantages and disadvantages with regard to memory footprint, joining latency, deployment complexity, etc. In this work, we analyze the performance tradeoffs associated with these two models using Apache Samza.

引用

页码：267 / 274

页数：8

共 50 条

[41] Mixing enhancement in a multi-stream injection nozzle
Vorobieff, Peter
Truman, C. Randall
Ragheb, Adam M.
Elliott, Gregory S.
Laystrom-Woodard, Julia K.
King, Darren M.
Carroll, David L.
Solomon, Wayne C.
[J]. EXPERIMENTS IN FLUIDS, 2011, 51 (03) : 711 - 722
[42] Multi-task learning とmulti-stream monocular depth estimation using integrated model with multi-task learning and multi-stream
Takamine, Michiru
Endo, Satoshi
[J]. Transactions of the Japanese Society for Artificial Intelligence, 2021, 36 (05): : 1 - 9
[43] OPTIMAL SEQUENTIAL DETECTION IN MULTI-STREAM DATA
Chan, Hock Peng
[J]. ANNALS OF STATISTICS, 2017, 45 (06): : 2736 - 2763
[44] Compact and Multi-Stream Heat Exchanger Design
Hayashi, Somei
Siemanond, Kitipat
[J]. 28TH EUROPEAN SYMPOSIUM ON COMPUTER AIDED PROCESS ENGINEERING, 2018, 43 : 663 - 668
[45] Thermal design of multi-stream heat exchangers
Picón-Núñez, M
Polley, GT
Medina-Flores, M
[J]. APPLIED THERMAL ENGINEERING, 2002, 22 (14) : 1643 - 1660
[46] Multi-stream parameterization for structural speech recognition
Asakawa, Satoshi
Minematsu, Nobuaki
Hirose, Keikichi
[J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 4097 - +
[47] The multi-stream flows and the dynamics of the cosmic web
Shandarin, Sergei F.
[J]. JOURNAL OF COSMOLOGY AND ASTROPARTICLE PHYSICS, 2011, (05):
[48] DBN based multi-stream models for speech
Zhang, YM
Diao, Q
Huang, S
Hu, W
Bartels, C
Bilmes, J
[J]. 2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PROCEEDINGS: SPEECH PROCESSING I, 2003, : 836 - 839
[49] Flexible multi-stream framework for speech recognition using multi-tape finite-state transducers
Hetherington, I. Lee
Shu, Han
Glass, James R.
[J]. 2006 IEEE International Conference on Acoustics, Speech and Signal Processing, Vols 1-13, 2006, : 417 - 420
[50] Multi-Scale and Multi-Stream Fusion Network for Pansharpening
Jian, Lihua
Wu, Shaowu
Chen, Lihui
Vivone, Gemine
Rayhana, Rakiba
Zhang, Di
[J]. REMOTE SENSING, 2023, 15 (06)

← 1 2 3 4 5 →