Activation Functions
Shifted Rectified Linear Unit
Introduced by Pishchik in Trainable Activations for Image ClassificationThe Shifted Rectified Linear Unit, or ShiLU, is a modification of ReLU activation function that has trainable parameters.
$$ShiLU(x) = \alpha ReLU(x) + \beta$$
Source: Trainable Activations for Image Classification
Papers
| Paper | Code | Results | Date | Stars |
|---|
ReLU
