Sökning: "gles attention"

Hittade 3 uppsatser innehållade orden gles attention.

  1. 1. Incorporating Sparse Attention Mechanism into Transformer for Object Detection in Images

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Cuong Duc Dao; [2022]
    Nyckelord :Detection Transformer; Sparse Attentions; Sparsity; Attention Mechanism; Learnable sparsity; Object Detection; Detektionstransformator; gles attention; gleshet; träningsbar gleshet; objektdetektion;

    Sammanfattning : DEtection TRansformer, DETR, introduces an innovative design for object detection based on softmax attention. However, the softmax operation produces dense attention patterns, i.e., all entries in the attention matrix receive a non-zero weight, regardless of their relevance for detection. LÄS MER

  3. 2. Benchmarking Deep Reinforcement Learning on Continuous Control Tasks : AComparison of Neural Network Architectures and Environment Designs

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Daniel Sahlin; [2022]
    Nyckelord :Deep learning; Reinforcement learning; Reward functions; Neural networks; Furuta pendulum; Djupinlärning; Förstärkningsinlärning; Belöningsfunktioner; Neurala nätverk; Furuta-pendel;

    Sammanfattning : Deep Reinforcement Learning (RL) has received much attention in recent years. This thesis investigates how reward functions, environment termination conditions, Neural Network (NN) architectures, and the type of the deep RL algorithm aect the performance for continuous control tasks. LÄS MER

  4. 3. Skogsskötsel för att minimera stormfällning över järnväg

    L3-uppsats, SLU/Southern Swedish Forest Research Centre

    Författare :Magnus Orsander; [2003]
    Nyckelord :skogsskötsel; stormfällning; skador på järnvägsspår;

    Sammanfattning : The society of today is dependent of secure transports and deliveries of electrical power. Interruptions in different activities because of fallen trees cost a great deal of money in form of reparations and claimed damages for transport companies and electrical suppliers. Fallen trees along some railway sections are a severe problem. LÄS MER