Sökning: "Hadoop"

Visar resultat 1 - 5 av 77 uppsatser innehållade ordet Hadoop.

  1. 1. Sequential Anomaly Detection for Log Data Using Deep Learning

    Master-uppsats, Göteborgs universitet/Institutionen för matematiska vetenskaper

    Författare :Lina Hammargren; Wei Wu; [2021-06-14]
    Nyckelord :anomaly detection; recurrent neural network; long short-term memory; semi-supervised learning; seq2seq; transformer; unsupervised learning; log analysis;

    Sammanfattning : Abstract Software development with continuous integration changes needs frequent testing for assessment. Analyzing the test output manually is time-consuming and automating this process could be beneficial to an organization. LÄS MER

  3. 2. Hadoop scalability evaluation for machine learning algorithms on physical machines : Parallel machine learning on computing clusters

    Kandidat-uppsats, Högskolan i Skövde/Institutionen för informationsteknologi

    Författare :Jens Roderus; Simon Larson; Eric Pihl; [2021]
    Nyckelord :Parallel machine learning; cluster computing; Hadoop; performance analysis;

    Sammanfattning : The amount of available data has allowed the field of machine learning to flourish. But with growing data set sizes comes an increase in algorithm execution times. LÄS MER

  4. 3. Automating Log Analysis

    Master-uppsats, Blekinge Tekniska Högskola/Institutionen för datavetenskap

    Författare :Sri Sai Manoj Kommineni; Akhila Dindi; [2021]
    Nyckelord :Anomaly detection; Log analysis; Unsupervised learning;

    Sammanfattning : Background: With the advent of the information age, there are many large numbers of services rising which run on several clusters of computers.  Maintaining such large complex systems is a very difficult task. Developers use one tool which is common for almost all software systems, they are the console logs. LÄS MER

  5. 4. Evaluating the use of Machine Learning for Fault Detection using Log File Analysis

    Kandidat-uppsats, Mittuniversitetet/Institutionen för informationssystem och –teknologi

    Författare :Rosen Nikolaev Tenov; [2021]
    Nyckelord :Machine learning; fault detection; log file; artificial neural network; Maskininlärning; feldetektering; loggfil; artificiellt neuralt nätverk;

    Sammanfattning : Under de senaste åren fick maskininlärning mer och mer popularitet i samhället. Den implementeras i stor utsträckning inom många datavetenskapliga områden, t.ex. igenkänning av tal, video, objekt, sentimentanalys osv. LÄS MER

  7. 5. Spark on Kubernetes using HopsFS as a backing store : Measuring performance of Spark with HopsFS for storing and retrieving shuffle files while running on Kubernetes

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Shivam Saini; [2020]
    Nyckelord :Spark; Kubernetes; HopsFS; Data processing; Distributed and Parallel processing;

    Sammanfattning : Data is a raw list of facts and details, such as numbers, words, measurements or observations that is not useful for us all by itself. Data processing is a technique that helps to process the data in order to get useful information out of it. Today, the world produces huge amounts of data that can not be processed using traditional methods. LÄS MER