Sökning: "BERT"

Visar resultat 6 - 10 av 244 uppsatser innehållade ordet BERT.

1. 6. Natural Language Inference Transfer Learning in a Multi-Task Contract Dataset : In the Case of ContractNLI: a Document Information Extraction System

   Master-uppsats, Uppsala universitet/Institutionen för lingvistik och filologi

   Författare :Yiu Kei Tang; [2023]
   Nyckelord :;

   Sammanfattning : This thesis investigates the enhancement of legal contract Natural Language Inference (NLI) classification through supervised fine-tuning on general domain NLI, in the case of ContractNLI and Span NLI BERT (Koreeda and Manning, 2021), a multi-task document information extraction dataset and framework. Annotated datasets of a specific professional domain are scarce due to the high time and labour cost required to create them. LÄS MER

3. 7. Utilizing Transformers with Domain-Specific Pretraining and Active Learning to Enable Mining of Product Labels

   Uppsats för yrkesexamina på avancerad nivå, Uppsala universitet/Avdelningen för beräkningsvetenskap

   Författare :Erik Norén; [2023]
   Nyckelord :Machine Learning; Natural Language Processing; NLP; BERT; Active Learning; AL; Pharmacovigilance; UMC; Uppsala Monitoring Centre; Structured Product Label; SPL; Transformers; Domain-Specific Pretraining; NER; Named Entity Recognition; Adverse Drug Reaction; ADR;

   Sammanfattning : Structured Product Labels (SPLs), the package inserts that accompany drugs governed by the Food and Drugs Administration (FDA), hold information about Adverse Drug Reactions (ADRs) that exists associated with drugs post-market. This information is valuable for actors working in the field of pharmacovigilance aiming to improve the safety of drugs. LÄS MER

4. 8. Detection of insurance fraud using NLP and ML

   Master-uppsats, Lunds universitet/Matematisk statistik

   Författare :Rasmus Bäcklund; Hampus Öhman; [2023]
   Nyckelord :Technology and Engineering;

   Sammanfattning : Machine-Learning can sometimes see things we as humans can not. In this thesis we evaluated three different Natural Language Procces-techniques: BERT, word2vec and linguistic analysis (UDPipe), on their performance in detecting insurance fraud based on transcribed audio from phone calls (referred to as audio data) and written text (referred to as text-form data), related to insurance claims. LÄS MER

5. 9. Mitigating Unintended Bias in Toxic Comment Detection using Entropy-based Attention Regularization

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Fabio Camerota; [2023]
   Nyckelord :XLNet; BERT; Toxic Comment Classification; Entropy-based Attention Regularization; XLNet; BERT; Toxisk Kommentar Klassificering; Entropibaserad uppmärksamhetsreglering;

   Sammanfattning : The proliferation of hate speech is a growing challenge for social media platforms, as toxic online comments can have dangerous consequences also in real life. There is a need for tools that can automatically and reliably detect hateful comments, and deep learning models have proven effective in solving this issue. LÄS MER

7. 10. Speech Classification using Acoustic embedding and Large Language Models Applied on Alzheimer’s Disease Prediction Task

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Maryam Kheirkhahzadeh; [2023]
   Nyckelord :Speech classification; Alzheimer’s disease detection; GPT-3; BERT; Text embedding; Dementia; wav2vec2.0; Klassificering av tal; detektion av Alzheimer’s sjukdom; GPT-3; BERT; textinbäddning; demens; wav2vec2.0;

   Sammanfattning : Alzheimer’s sjukdom är en neurodegenerativ sjukdom som leder till demens. Den kan börja tyst i de tidiga stadierna och fortsätta under åren till en allvarlig och obotlig fas. Språkstörningar uppstår ofta som ett av de tidiga symptomen och kan till slut leda till fullständig mutism i de avancerade stadierna av sjukdomen. LÄS MER