Sökning: "multimodal fusion"

Visar resultat 1 - 5 av 20 uppsatser innehållade orden multimodal fusion.

  1. 1. Where to Fuse

    Master-uppsats, Lunds universitet/Matematisk statistik

    Författare :Lukas Petersson; [2024]
    Nyckelord :Technology and Engineering;

    Sammanfattning : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. LÄS MER

  3. 2. Movement Estimation with SLAM through Multimodal Sensor Fusion

    Master-uppsats, Linköpings universitet/Medie- och Informationsteknik; Linköpings universitet/Tekniska fakulteten

    Författare :Jimmy Cedervall Lamin; [2024]
    Nyckelord :slam; discrete-slam; continuous-slam; synchronous; asynchronous; computer vision; BRISK; opencv; ceres; visual; inertial; sensor fusion; multimodal; Simultaneous Localization and Mapping; time offset; pose estimation; quaternions; movement estimation;

    Sammanfattning : In the field of robotics and self-navigation, Simultaneous Localization and Mapping (SLAM) is a technique crucial for estimating poses while concurrently creating a map of the environment. Robotics applications often rely on various sensors for pose estimation, including cameras, inertial measurement units (IMUs), and more. LÄS MER

  4. 3. Classifying femur fractures using federated learning

    Master-uppsats, Linköpings universitet/Statistik och maskininlärning

    Författare :Hong Zhang; [2024]
    Nyckelord :Atypical femur fracture; Federated Learning; Neural Network; Classification;

    Sammanfattning : The rarity and subtle radiographic features of atypical femoral fractures (AFF) make it difficult to distinguish radiologically from normal femoral fractures (NFF). Compared with NFF, AFF has subtle radiological features and is associated with the long-term use of bisphosphonates for the treatment of osteoporosis. LÄS MER

  5. 4. Building Information Modeling Connection Recommendation Based on Machine Learning Using Multimodal Information

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Zixin Zhou; [2023]
    Nyckelord :Building information modeling; Tekla Structures; Connection; Classification; Machine learning; Multimodal data fusion;

    Sammanfattning : Den ökande komplexiteten i byggprojekt ger upphov till behovet av ett effektivt sätt att designa, hantera och underhålla strukturer. Byggnadsinformationsmodellering (BIM) underlättar dessa processer genom att tillhandahålla en digital representation av fysiska strukturer. LÄS MER

  7. 5. Robust Multi-Modal Fusion for 3D Object Detection : Using multiple sensors of different types to robustly detect, classify, and position objects in three dimensions.

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Viktor Kårefjärd; [2023]
    Nyckelord :Computer Vision; 3D Object Detection; Multi-Modal Fusion; Deep Learning; Datorseenden; 3D-objektdetektion; Multimodal fusion; Djupinlärning;

    Sammanfattning : The computer vision task of 3D object detection is fundamentally necessary for autonomous driving perception systems. These vehicles typically feature a multitude of sensors, such as cameras, radars, and light detection and ranging sensors. LÄS MER