Sökning: "Two-tower networks"

Hittade 2 uppsatser innehållade orden Two-tower networks.

  1. 1. Messing With The Gap: On The Modality Gap Phenomenon In Multimodal Contrastive Representation Learning

    Uppsats för yrkesexamina på avancerad nivå, Uppsala universitet/Industriell teknik

    Författare :Mohammad Al-Jaff; [2023]
    Nyckelord :Multimodal machine learning; Representation learning; Self-supervised learning; contrastive learning; computer vision; computational biology; bioinformatics;

    Sammanfattning : In machine learning, a sub-field of computer science, a two-tower architecture model is a specialised type of neural network model that encodes paired data from different modalities (like text and images, sound and video, or proteomics and gene expression profiles) into a shared latent representation space. However, when training these models using a specific contrastive loss function, known as the multimodalinfoNCE loss, seems to often lead to a unique geometric phenomenon known as the modality gap. LÄS MER

  3. 2. Text Content Features for Hybrid Recommendations : Pre-trained Language Models for Better Recommendations

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Mariya Lazarova; [2021]
    Nyckelord :Recommendation Systems; Natural Language Processing; Pre-trained language models; BERT; Two-tower networks; Rekommendationssystem; Naturlig språkbehandling; Förtränande språkmodeller; BERT; Två-tornnätverk.;

    Sammanfattning : Nowadays, with the ever growing availability of options in many areas of our lives, it is crucial to have good ways to navigate your choices. This is why recommendation engines’ role is growing more important. Recommenders are often based on user-item interaction. LÄS MER