Sökning: "Self-attention"

Visar resultat 1 - 5 av 16 uppsatser innehållade ordet Self-attention.

  1. 1. Comparison of VADER and Pre-Trained RoBERTa: A Sentiment Analysis Application

    Kandidat-uppsats, Lunds universitet/Statistiska institutionen

    Författare :Linda Erwe; Xin Wang; [2024]
    Nyckelord :sentiment analysis; natural language processing; BERT; VADER; sustainability report; Mathematics and Statistics;

    Sammanfattning : Purpose: The purpose of this study is to examine how the overall sentiment results from VADER and a pre-trained RoBERTa model differ. The study investigates potential differences in terms of the median and shape of the two distributions. Data: The sustainability reports of 50 independent random companies are selected as the sample. LÄS MER

  3. 2. Using Machine Learning to Optimize Near-Earth Object Sighting Data at the Golden Ears Observatory

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Laura Murphy; [2023]
    Nyckelord :Near-Earth Object Detection; Machine Learning; Deep Learning; Visual Transformers;

    Sammanfattning : This research project focuses on improving Near-Earth Object (NEO) detection using advanced machine learning techniques, particularly Vision Transformers (ViTs). The study addresses challenges such as noise, limited data, and class imbalance. LÄS MER

  4. 3. Moving Through Stillness : En kvalitativ studie om hur en konstnärlig praktik kan användas i dansundervisning

    Kandidat-uppsats, Stockholms konstnärliga högskola/Institutionen för danspedagogik

    Författare :Luusi Kateme; [2023]
    Nyckelord :artistic practice; didactic; dance education; somatic; somatic practice; konstnärlig praktik; didaktik; dansundervisning; somatik; somatisk praktik;

    Sammanfattning : The purpose of the bachelor thesis is to, from a didactic perspective, gain increased knowledge about how an artistic practice can be used in dance education. The study is conducted through a qualitative research method using the practice Dancing is... LÄS MER

  5. 4. Evaluating Text Summarization Models on Resumes : Investigating the Quality of Generated Resume Summaries and their Suitability as Resume Introductions

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Amanda Krohn; [2023]
    Nyckelord :Natural language processing; Abstractive text summarization; Transformer architecture; Fine-tuning; Resumes; Språkteknologi; Abstrakt textsammanfattning; Transformer-arkitektur; Finjustering; CV;

    Sammanfattning : This thesis aims to evaluate different abstractive text summarization models and techniques for summarizing resumes. It has two main objectives: investigate the models’ performance on resume summarization and assess the suitability of the generated summaries as resume introductions. LÄS MER

  7. 5. Graph Neural Network for Traffic Flow Forecasting : Does an enriched adjacency matrix with low dimensional dataenhance the performance of GNN for traffic flow forecasting?

    Uppsats för yrkesexamina på avancerad nivå, Högskolan i Halmstad/Akademin för informationsteknologi

    Författare :Fredrik Kortetjärvi; Rohullah Khorami; [2023]
    Nyckelord :Graph Neural Network;

    Sammanfattning : Nowadays, machine learning methods are used in many applications and deployed in manyelectronic devices to solve problems and predict future states. One of the challenges mostbig cities confront is traffic jams since the roads are crammed with more and more vehicles, which will easily cause traffic congestion. LÄS MER