Sökning: "förlustlandskap"

Hittade 1 uppsats innehållade ordet förlustlandskap.

1. 1. On Linear Mode Connectivity up to Permutation of Hidden Neurons in Neural Network : When does Weight Averaging work?

   Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Författare :Adhithyan Kalaivanan; [2023]
   Nyckelord :Mode Connectivity; Representation Learning; Loss Landscape; Network Symmetry; Lägesanslutning; representationsinlärning; förlustlandskap; nätverkssymmetri;

   Sammanfattning : Neural networks trained using gradient-based optimization methods exhibit a surprising phenomenon known as mode connectivity, where two independently trained network weights are not isolated low loss minima in the parameter space. Instead, they can be connected by simple curves along which the loss remains low. LÄS MER