Table 4 Types of activation function in ANN models.
Name | Equations |
|---|---|
Hyperbolic Tangent (Tanh) | \(\:\text{f}\left(\text{x}\right)=\frac{({\text{e}}^{\text{x}}-{\text{e}}^{-\text{x}})}{({\text{e}}^{\text{x}}+{\text{e}}^{-\text{x}})}\) |
Logistic (Sigmoid) | \(\:\text{f}\left(\text{x}\right)=\frac{1}{1+{\text{e}}^{-\text{x}}}\) |
Rectified Linear Unit (ReLU) | \(\:\text{f}\left(\text{x}\right)=\text{m}\text{a}\text{x}(0,\:\text{x})\) |
Linear (Identify) | \(\:\text{f}\left(\text{x}\right)=\text{x}\) |
