Sökning: "redundancy in language models"

Hittade 4 uppsatser innehållade orden redundancy in language models.

1. 1. Distillation or loss of information? : The effects of distillation on model redundancy

   Master-uppsats, Uppsala universitet/Institutionen för lingvistik och filologi

   Författare :Eva Elzbieta Sventickaite; [2022]
   Nyckelord :distillation; distillation effects; distilbert; distilmbert; distilroberta; distilgpt-2; distilled neurons; redundancy; redundancy in neural networks; redundancy in language models; neuron reduction in language models; distilled language models;

   Sammanfattning :     The necessity for billions of parameters in large language models has lately been questioned as there are still unanswered questions regarding how information is captured in the networks. It could be argued that without this knowledge, there may be a tendency to overparametarize the models. LÄS MER

3. 2. Active Learning for Named Entity Recognition with Swedish Language Models

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Joey Öhman; [2021]
   Nyckelord :Active learning; Named entity recognition; Language models; Natural language processing; Bert; Swedish; Aktiv inlärning; Namnigenkänning; Språkmodeller; Naturlig språkbehandling; Bert; Svenska;

   Sammanfattning : The recent advancements of Natural Language Processing have cleared the path for many new applications. This is primarily a consequence of the transformer model and the transfer-learning capabilities provided by models like BERT. However, task-specific labeled data is required to fine-tune these models. LÄS MER

4. 3. CASE STUDIES ON MODELING SECURITY IMPLICATIONS ON SAFETY

   Magister-uppsats, Mälardalens högskola/Akademin för innovation, design och teknik

   Författare :Aleksandar Matović; [2019]
   Nyckelord :model-checking; security; safety-critical; rebeca; modeling security implications;

   Sammanfattning : Security is widely recognized as an important property that is tightly interdependentwith safety in safety-critical systems. The goal of this thesis is to conduct case studies on the implications that security attacks may have on the safety of these systems. LÄS MER

5. 4. Structural Diagnosis Implementation of Dymola Models using Matlab Fault Diagnosis Toolbox

   Master-uppsats, Linköpings universitet/Fordonssystem

   Författare :Petter Lannerhed; [2017]
   Nyckelord :Diagnosis; Structural Methods; Observer Construction;

   Sammanfattning : Models are of great interest in many fields of engineering as they enable prediction of a systems behaviour, given an initial mode of the system. However, in the field of model-based diagnosis the models are used in a reverse manner, as they are combined with the observations of the systems behaviour in order to estimate the system mode. LÄS MER