On the Optimality of Data Exchange for Master-Aided Edge Computing Systems

被引:2
|
作者
Chen, Haoning [1 ]
Long, Junfeng [1 ]
Ma, Shuai [2 ]
Tang, Mingjian [3 ]
Wu, Youlong [1 ]
机构
[1] Shanghai Tech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Westpac Banking Corp, Sydney, NSW 2000, Australia
关键词
Distributed computing; MapReduce; computation; communication; FUNDAMENTAL LIMITS; PERFORMANCE;
D O I
10.1109/TCOMM.2023.3238373
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Edge computing has recently garnered significant interest in many Internet of Things (IoT) applications. However, the excessive overhead during data exchange still remains an open challenge, especially for large-scale data processing tasks. This paper considers a master-aided distributed computing system with multiple edge computing nodes and a master node, where the master node helps edge nodes compute output functions. We propose a coded scheme to reduce the communication latency by exploiting computation and communication capabilities of all nodes and creating coded multicast opportunities. More importantly, we prove that the proposed scheme is always optimal, i.e., achieving the minimum communication latency, for arbitrary computing and storage abilities at the master. This extends the previous optimality results in the extreme cases (either the master could compute all input files or compute nothing) to the general case. Finally, numerical results and TeraSort experiments demonstrate that our schemes can greatly reduce the communication latency compared with the existing schemes.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
  • [41] EdgeCare: Leveraging Edge Computing for Collaborative Data Management in Mobile Healthcare Systems
    Li, Xiaohuan
    Huang, Xumin
    Li, Chunhai
    Yu, Rong
    Shu, Lei
    IEEE ACCESS, 2019, 7 : 22011 - 22025
  • [42] OPTIMALITY CONDITIONS FOR SYSTEMS WITH INSUFFICIENT DATA
    PAPAGEORGIOU, NS
    BULLETIN OF THE AUSTRALIAN MATHEMATICAL SOCIETY, 1990, 41 (01) : 45 - 56
  • [43] Fog-assisted de-duplicated data exchange in distributed edge computing networks
    Said, Ghawar
    Ghani, Anwar
    Ullah, Ata
    Alzahrani, Abdulrahman
    Azeem, Muhammad
    Ahmad, Rashid
    Kim, Do-Hyeun
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [44] Online data caching in edge computing
    Han, Xinxin
    Gao, Guichen
    Wang, Yang
    Ting, Hing-Fung
    You, Ilsun
    Zhang, Yong
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (17):
  • [45] Multimedia Data Analysis With Edge Computing
    Chen, Shu-Ching
    IEEE MULTIMEDIA, 2021, 28 (04) : 5 - 7
  • [46] Efficient Pareto Optimality-based Task Scheduling for Vehicular Edge Computing
    Da Costa, Joahannes B. D.
    de Souza, Allan M.
    Rosario, Denis
    Sommer, Christoph
    Villas, Leandro A.
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [47] ECOSECURITY: Tackling Challenges Related to Data Exchange and Security An edge-computing-enabled secure and efficient data exchange architecture for the Energy Internet
    Guan, Zhitao
    Zhang, Yue
    Si, Guanlin
    Zhou, Zhenyu
    Wu, Jun
    Mumta, Shahid
    Rodriguez, Jonathan
    IEEE CONSUMER ELECTRONICS MAGAZINE, 2019, 8 (02) : 61 - 65
  • [48] Privacy Techniques for Edge Computing Systems
    Rao, Fang-Yu
    Bertino, Elisa
    PROCEEDINGS OF THE IEEE, 2019, 107 (08) : 1632 - 1654
  • [49] A Survey on Edge Computing Systems and Tools
    Liu, Fang
    Tang, Guoming
    Li, Youhuizi
    Cai, Zhiping
    Zhang, Xingzhou
    Zhou, Tongqing
    PROCEEDINGS OF THE IEEE, 2019, 107 (08) : 1537 - 1562
  • [50] Financial Data Security Management Method and Edge Computing Platform Based on Intelligent Edge Computing and Big Data
    Luo, Yanni
    IETE JOURNAL OF RESEARCH, 2023, 69 (08) : 5187 - 5195