Distributed Network Telemetry With Resource Efficiency and Full Accuracy

Haifeng Sun

doi:10.1109/TNET.2023.3327345

Distributed Network Telemetry With Resource Efficiency and Full Accuracy

2024-06-01

0

PRE

AI

DOI：10.1109/TNET.2023.3327345

Original

Original request for help

Save

Abstract

En 中文

Network telemetry is essential for administrators to monitor massive data traffic in a network-wide manner. Existing telemetry solutions often face the dilemma between resource efficiency (i.e., low CPU, memory, and bandwidth overhead) and full accuracy (i.e., error-free and holistic measurement). We break this dilemma via a network-wide architectural design, which simultaneously achieves resource efficiency and full accuracy in flow-level telemetry for large-scale data centers. carefully coordinates the collaboration among different types of entities in the whole network to execute telemetry operations, such that the resource constraints of each entity are satisfied without compromising full accuracy. It further addresses consistency in network-wide epoch synchronization and accountability in error-free packet loss inference. We prototype in DPDK and P4. Testbed experiments on commodity servers and Tofino switches demonstrate the effectiveness of over state-of-the-art solutions.

Keywords:

Telemetry

Control systems

Collaboration

Monitoring

Measurement uncertainty

Data centers

Bandwidth

Network measurement

distributed systems

telemetry language

Distributed Network Telemetry With Resource Efficiency and Full Accuracy

Abstract

Journal

Organization