Sökning: "Joseph Attieh"

Hittade 1 uppsats innehållade orden Joseph Attieh.

  1. 1. Optimizing the Performance of Text Classification Models by Improving the Isotropy of the Embeddings using a Joint Loss Function

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Joseph Attieh; [2022]
    Nyckelord :Text Classification; Isotropy; Embeddings; BERT; IsoScore; Klassificering av Text; Isotropi; Inbäddningar; BERT; IsoScore;

    Sammanfattning : Recent studies show that the spatial distribution of the sentence representations generated from pre-trained language models is highly anisotropic, meaning that the representations are not uniformly distributed among the directions of the embedding space. Thus, the expressiveness of the embedding space is limited, as the embeddings are less distinguishable and less diverse. LÄS MER