Scaling a monitoring infrastructure for the Akamai network

被引:6
|
作者
Repantis T. [1 ]
Smith S. [2 ]
Cohen J. [1 ]
Wein J. [1 ]
机构
[1] Akamai Technologies, Cambridge
[2] Clustrix, Inc., San Francisco
来源
Operating Systems Review (ACM) | 2010年 / 44卷 / 03期
关键词
Distributed databases; Distributed systems; Monitoring; Scalability; Stream processing;
D O I
10.1145/1842733.1842737
中图分类号
学科分类号
摘要
We describe the design of, and experience with, Query, a monitoring system that supports the Akamai EdgePlatform. Query is a foundation of Akamai's approach to administering its distributed computing platform, allowing administrators, operations staff, developers, customers, and automated systems near real-time access to data about activity in Akamai's network. Users extract information regarding the current state of the network via a SQL-like interface. Versions of Query have been deployed since the inception of Akamai's platform, and it has scaled to support a distributed platform of 60,000+ servers, collecting over 200 gigabytes of data and answering over 30,000 queries approximately every 2 minutes.
引用
收藏
页码:20 / 26
页数:6
相关论文
共 50 条
  • [31] Scaling Hardware Accelerated Network Monitoring to Concurrent and Dynamic Queries With *Flow
    Sonchack, John
    Michel, Oliver
    Aviv, Adam J.
    Keller, Eric
    Smith, Jonathan M.
    PROCEEDINGS OF THE 2018 USENIX ANNUAL TECHNICAL CONFERENCE, 2018, : 823 - 835
  • [32] Challenges in Scaling Up Biofuels Infrastructure
    Richard, Tom L.
    SCIENCE, 2010, 329 (5993) : 793 - 796
  • [33] A grid monitoring model over network-aware IaaS cloud infrastructure
    Pardi, Silvio
    Del Prete, Domenico
    Russo, Guido
    International Journal of High Performance Computing and Networking, 2013, 7 (03) : 195 - 204
  • [34] Design and Implementation of a Wireless Sensor Network Based Critical Infrastructure Monitoring System
    Bam, Gorkem
    Dilcan, Enes
    Dogan, Bekir
    Dinc, Baris
    Tavli, Bulent
    2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 317 - 320
  • [35] Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology
    Campana, S.
    Brown, A.
    Bonacorsi, D.
    Capone, V.
    De Girolamo, D.
    Casani, A. F.
    Flix, J.
    Forti, A.
    Gable, I.
    Gutsche, O.
    Hesnaux, A.
    Liu, S.
    Munoz, F. Lopez
    Magini, N.
    McKee, S.
    Mohammed, K.
    Rand, D.
    Reale, M.
    Roiser, S.
    Zielinski, M.
    Zurawski, J.
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [36] Mesh Network Design for Smart Charging Infrastructure and Electric Vehicle Remote Monitoring
    Shepelev, Aleksey
    Chung, Ching-Yen
    Chu, Chi-Cheng
    Gadh, Rajit
    2013 INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2013): FUTURE CREATIVE CONVERGENCE TECHNOLOGIES FOR NEW ICT ECOSYSTEMS, 2013, : 250 - 255
  • [37] Design and Implementation of Network Monitoring System for Campus Infrastructure Using Software Agents
    Espinel-Villalobos, Rodrigo, I
    Ardila-Triana, Erick
    Zarate-Ceballos, Henry
    Ortiz-Trivino, Jorge E.
    INGENIERIA E INVESTIGACION, 2022, 42 (01):
  • [38] A Network Infrastructure for Monitoring Coastal Environments and Study Climate Changes in Marine Systems
    Campagnaro, Filippo
    Toffolo, Nicola
    Pozzebon, Alessandro
    Francescon, Roberto
    Barausse, Alberto
    Airoldi, Laura
    Zorzi, Michele
    2022 OCEANS HAMPTON ROADS, 2022,
  • [39] An optimal Communications Protocol for Maximizing Lifetime of Railway Infrastructure Wireless Monitoring Network
    Ma, Xiaoping
    Dong, Honghui
    Liu, Xiang
    Jia, Limin
    Xie, Guo
    Bian, Zheyong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (08) : 3347 - 3357
  • [40] Conductor Temperature Monitoring as a Tool to Increase Capacity of Transmission Network Infrastructure Elements
    Jenkins, A.
    Mekhanoshin, B.
    Shkaptsov, V.
    2010 IEEE PES TRANSMISSION AND DISTRIBUTION CONFERENCE AND EXPOSITION: SMART SOLUTIONS FOR A CHANGING WORLD, 2010,