On the Optimality of Data Exchange for Master-Aided Edge Computing Systems

被引:2
|
作者
Chen, Haoning [1 ]
Long, Junfeng [1 ]
Ma, Shuai [2 ]
Tang, Mingjian [3 ]
Wu, Youlong [1 ]
机构
[1] Shanghai Tech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Westpac Banking Corp, Sydney, NSW 2000, Australia
关键词
Distributed computing; MapReduce; computation; communication; FUNDAMENTAL LIMITS; PERFORMANCE;
D O I
10.1109/TCOMM.2023.3238373
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Edge computing has recently garnered significant interest in many Internet of Things (IoT) applications. However, the excessive overhead during data exchange still remains an open challenge, especially for large-scale data processing tasks. This paper considers a master-aided distributed computing system with multiple edge computing nodes and a master node, where the master node helps edge nodes compute output functions. We propose a coded scheme to reduce the communication latency by exploiting computation and communication capabilities of all nodes and creating coded multicast opportunities. More importantly, we prove that the proposed scheme is always optimal, i.e., achieving the minimum communication latency, for arbitrary computing and storage abilities at the master. This extends the previous optimality results in the extreme cases (either the master could compute all input files or compute nothing) to the general case. Finally, numerical results and TeraSort experiments demonstrate that our schemes can greatly reduce the communication latency compared with the existing schemes.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
  • [31] Deep learning based mobile data offloading in mobile edge computing systems
    Zhao, Xianlong
    Yang, Kexin
    Chen, Qimei
    Peng, Duo
    Jiang, Hao
    Xu, Xianze
    Shuang, Xinzhuo
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 99 : 346 - 355
  • [32] Bridging Data Center AI Systems with Edge Computing for Actionable Information Retrieval
    Liu, Zhengchun
    Ali, Ahsan
    Kenesei, Peter
    Miceli, Antonino
    Sharma, Hemant
    Schwarz, Nicholas
    Trujillo, Dennis
    Yoo, Hyunseung
    Coffee, Ryan
    Layad, Naoufal
    Thayer, Jana
    Herbst, Ryan
    Yoon, Chunhong
    Foster, Ian
    PROCEEDINGS OF XLOOP 2021: THE 3RD ANNUAL WORKSHOP ON EXTREME-SCALE EXPERIMENT-IN-THE-LOOP COMPUTING, 2021, : 15 - 23
  • [33] Data Sharing-Aware Algorithms for Task Allocation in Edge Computing Systems
    Rabinia, Sanaz
    Grosu, Daniel
    2024 IEEE 24TH INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING, CCGRID 2024, 2024, : 658 - 662
  • [34] Algorithms for Data Sharing-Aware Task Allocation in Edge Computing Systems
    Rabinia, Sanaz
    Didar, Niloofar
    Brocanelli, Marco
    Grosu, Daniel
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2025, 36 (01) : 15 - 28
  • [35] Optimizing Communication Data Streams in Edge Computing Systems Using Bayesian Algorithms
    Gomez Larrakoetxea, Nerea
    Sanz Urquijo, Borja
    Pastor Lopez, Iker
    Garcia Barruetabena, Jon
    Garcia Bringas, Pablo
    16TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MODELS IN INDUSTRIAL AND ENVIRONMENTAL APPLICATIONS (SOCO 2021), 2022, 1401 : 122 - 131
  • [36] Data Processing in Cyber-Physical-Social Systems Through Edge Computing
    Dautov, Rustem
    Distefano, Salvatore
    Bruneo, Dario
    Longo, Francesco
    Merlino, Giovanni
    Puliafito, Antonio
    IEEE ACCESS, 2018, 6 : 29822 - 29835
  • [37] A Data Transformation Adapter for Smart Manufacturing Systems with Edge and Cloud Computing Capabilities
    Saez, Miguel
    Lengieza, Steven
    Maturana, Francisco
    Barton, Kira
    Tilbury, Dawn
    2018 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY (EIT), 2018, : 519 - 524
  • [38] Data Replication in Mobile Edge Computing Systems to Reduce Latency in Internet of Things
    Saranya, N.
    Geetha, K.
    Rajan, C.
    WIRELESS PERSONAL COMMUNICATIONS, 2020, 112 (04) : 2643 - 2662
  • [39] Handling Data Handoff of AI-Based Applications in Edge Computing Systems
    Scotece, Domenico
    Fiandrino, Claudio
    Foschini, Luca
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (04): : 4435 - 4447
  • [40] Data Replication in Mobile Edge Computing Systems to Reduce Latency in Internet of Things
    N. Saranya
    K. Geetha
    C. Rajan
    Wireless Personal Communications, 2020, 112 : 2643 - 2662