Implementing Federated Governance in Data Mesh Architecture

被引:0
|
作者
Dolhopolov, Anton [1 ]
Castelltort, Arnaud [1 ]
Laurent, Anne [1 ]
机构
[1] Univ Montpellier, LIRMM, CNRS, F-34095 Montpellier, France
关键词
decentralized systems; federated governance; metadata management; data mesh; blockchain;
D O I
10.3390/fi16040115
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Analytical data platforms have been used for decades to improve organizational performance. Starting from the data warehouses used primarily for structured data processing, through the data lakes oriented for raw data storage and post-hoc data analyses, to the data lakehouses-a combination of raw storage and business intelligence pre-processing for improving the platform's efficacy. But in recent years, a new architecture called Data Mesh has emerged. The main promise of this architecture is to remove the barriers between operational and analytical teams in order to boost the overall value extraction from the big data. A number of attempts have been made to formalize and implement it in existing projects. Although being defined as a socio-technical paradigm, data mesh still lacks the technology support to enable its widespread adoption. To overcome this limitation, we propose a new view of the platform requirements alongside the formal governance definition that we believe can help in the successful adoption of the data mesh. It is based on fundamental aspects such as decentralized data domains and federated computational governance. In addition, we also present a blockchain-based implementation of a mesh platform as a practical validation of our theoretical proposal. Overall, this article demonstrates a novel research direction for information system decentralization technologies.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] A FEDERATED ARCHITECTURE FOR INFORMATION MANAGEMENT
    HEIMBIGNER, D
    MCLEOD, D
    [J]. ACM TRANSACTIONS ON OFFICE INFORMATION SYSTEMS, 1985, 3 (03): : 253 - 278
  • [32] Enabling trust in healthcare data exchange with a federated blockchain-based architecture
    Koscina, Mirko
    Manset, David
    Negri, Claudia
    Kempner, Octavio Perez
    [J]. 2019 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE WORKSHOPS (WI 2019 COMPANION), 2019, : 231 - 237
  • [33] From federated learning to federated neural architecture search: a survey
    Zhu, Hangyu
    Zhang, Haoyu
    Jin, Yaochu
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2021, 7 (02) : 639 - 657
  • [34] CowMesh: a data-mesh architecture to unify dairy industry data for prediction and monitoring
    Pakrashi, Arjun
    Wallace, Duncan
    Mac Namee, Brian
    Greene, Derek
    Gueret, Christophe
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 6
  • [35] From federated learning to federated neural architecture search: a survey
    Hangyu Zhu
    Haoyu Zhang
    Yaochu Jin
    [J]. Complex & Intelligent Systems, 2021, 7 : 639 - 657
  • [36] Implementing partnership-driven clinical federated electronic health record data sharing networks
    Stephens, Kari A.
    Anderson, Nicholas
    Lin, Ching-Ping
    Estiri, Hossein
    [J]. INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2016, 93 : 26 - 33
  • [37] Implementing federated database systems by compiling SchemaSQL
    Barbançon, F
    Miranker, DP
    [J]. IDEAS 2002: INTERNATIONAL DATABASE ENGINEERING AND APPLICATIONS SYMPOSIUM, PROCEEDINGS, 2002, : 192 - 201
  • [38] Implementing an Edge-Fog-Cloud architecture for stream data management
    Hernandez, Lilian
    Cao, Hung
    Wachowicz, Monica
    [J]. 2017 IEEE FOG WORLD CONGRESS (FWC), 2017, : 67 - 72
  • [39] An overview of implementing security and privacy in federated learning
    Hu, Kai
    Gong, Sheng
    Zhang, Qi
    Seng, Chaowen
    Xia, Min
    Jiang, Shanshan
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (08)
  • [40] AutoPilot: Experiences implementing a distributed data-driven agent architecture
    Foster, SS
    Moore, D
    Nebesh, BA
    [J]. TOOLS 26 - TECHNOLOGY OF OBJECT-ORIENTED LANGUAGES - PROCEEDINGS, 1998, : 259 - 268