Sökning: "eva elzbieta sventickaite"

Hittade 1 uppsats innehållade orden eva elzbieta sventickaite.

1. 1. Distillation or loss of information? : The effects of distillation on model redundancy

   Master-uppsats, Uppsala universitet/Institutionen för lingvistik och filologi

   Författare :Eva Elzbieta Sventickaite; [2022]
   Nyckelord :distillation; distillation effects; distilbert; distilmbert; distilroberta; distilgpt-2; distilled neurons; redundancy; redundancy in neural networks; redundancy in language models; neuron reduction in language models; distilled language models;

   Sammanfattning :     The necessity for billions of parameters in large language models has lately been questioned as there are still unanswered questions regarding how information is captured in the networks. It could be argued that without this knowledge, there may be a tendency to overparametarize the models. LÄS MER