Sökning: "Piecewise linear activation functions"

Hittade 1 uppsats innehållade orden Piecewise linear activation functions.

  1. 1. An Empirical Study on the Generation of Linear Regions in ReLU Networks : Exploring the Relationship Between Data Topology and Network Complexity in Discriminative Modeling

    Master-uppsats, KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Författare :Petter Eriksson; [2022]
    Nyckelord :Neural networks; Linear regions; Activation patterns; Piecewise linear activation functions; Data; Curvature; Neurala nätverk; Linjära regioner; Styckvis linjära aktiveringsfunktioner; Data; Krökning;

    Sammanfattning : The far-reaching successes of deep neural networks in a wide variety of learning tasks have prompted research on how model properties account for high network performance. For a specific class of models whose activation functions are piecewise linear, one such property of interest is the number of linear regions that the network generates. LÄS MER