Activation Functions

Activation Functions Explained - GELU, SELU, ELU, ReLU and moreMachine Learning From Scratch

General Logistic Function

Generalised logistic functionWikipedia

General Logistic Function

Intuitive Parameters from above. $A$: Lowest value for the graph, basically the lower asymptote. $K$: Upper Asymptote $B$: It's the steepness of the curve in the linear region. $C,Q, v$:Mostly take them to be 1.

You can get the sigmoid function form above with the following values:

$A$= 0 and all other parameters to be 1.

Graph with changing values of B