Sökning: "Apache Spark Structured Streaming"

Hittade 2 uppsatser innehållade orden Apache Spark Structured Streaming.

1. 1. A Real- time Log Correlation System for Security Information and Event Management

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Clémence Dubuc; [2021]
   Nyckelord :Correlation; SIEM; Security Logs; Apache Spark; Elastic Search; Korrelation; SIEM; Säkerhetsloggar; Apache Spark; Elastic Search;

   Sammanfattning : The correlation of several events in a period of time is a necessity for a threat detection platform. In the case of multistep attacks (attacks characterized by a sequence of executed commands), it allows detecting the different steps one by one and correlating them to raise an alert. LÄS MER

3. 2. Geo-distributed multi-layer stream aggregation

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Pietro Cannalire; [2018]
   Nyckelord :stream processing; geo-distributed; architecture; algorithms; windowing; data synopses; Apache Spark Structured Streaming; Apache Kafka; Misra-Gries algorithm; flödesbehandling; geo-distribuerade; arkitekturen; algoritmerna; windowing; data synopses; Apache Spark Structured Streaming; Apache Kafka; Misra-Gries-algoritmen;

   Sammanfattning : The standard processing architectures are enough to satisfy a lot of applications by employing already existing stream processing frameworks which are able to manage distributed data processing. In some specific cases, having geographically distributed data sources requires to distribute even more the processing over a large area by employing a geographically distributed architecture. LÄS MER