Activation Functions

General Logistic Function

Intuitive Parameters from above. $A$ : Lowest value for the graph, basically the lower asymptote. $K$ : Upper Asymptote $B$ : It's the steepness of the curve in the linear region. $C,Q, v$ :Mostly take them to be 1.

You can get the sigmoid function form above with the following values:

$A$ = 0 and all other parameters to be 1.

PreviousLoss function NextAutomatic Differentiation

Last updated 4 years ago

General Logistic Function

You can get the sigmoid function form above with the following values:

$A$ = 0 and all other parameters to be 1.