Data Stream Processing for Packet-Level Analytics

doi:10.3390/s21051735

2021-03-03

DOI：10.3390/s21051735

原文链接

查看原文

摘要

En 中文

One of the most challenging tasks for network operators is implementing accurate per-packet monitoring, looking for signs of performance degradation, security threats, and so on. Upon critical event detection, corrective actions must be taken to keep the network running smoothly. Implementing this mechanism requires the analysis of packet streams in a real-time (or close to) fashion. In a softwarized network context, Stream Processing Systems (SPSs) can be adopted for this purpose. Recent solutions based on traditional SPSs, such as Storm and Flink, can support the definition of general complex queries, but they show poor performance at scale. To handle input data rates in the order of gigabits per seconds, programmable switch platforms are typically used, although they offer limited expressiveness. With the proposed approach, we intend to offer high performance and expressive power in a unified framework by solely relying on SPSs for multicores. Captured packets are translated into a proper tuple format, and network monitoring queries are applied to tuple streams. Packet analysis tasks are expressed as streaming pipelines, running on general-purpose programmable network devices, and a second stage of elaboration can process aggregated statistics from different devices. Experiments carried out with an example monitoring application show that the system is able to handle realistic traffic at a 10 Gb/s speed. The same application scales almost up to 20 Gb/s speed thanks to the simple optimizations of the underlying framework. Hence, the approach proves to be viable and calls for the investigation of more extensive optimizations to support more complex elaborations and higher data rates.

Keyword:

software defined networking

packet-level analysis

data stream processing

multicore programming

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors

IF:

3.5

论文数:

7.2W

被引数:

20.9W

机构

University of Pisa

学者数:

3.1W

论文数: 2.4W

被引数: 2.4W

引用论文

Reduction potentials of blue and purple copper proteins in their unfolded states: a closer look at rack-induced coordination

JBIC Journal of Biological Inorganic Chemistry

IF0

1998-08-01

PREAI

Pernilla Wittung-Stafshede; Michael G. Hill; Ester Gomez; A. J. Di Bilio; B. Göran Karlsson; Johan Leckner; J. R. Winkler; Harry B. Gray; B. G. Malmström