Activation Functions
Cosine Linear Unit
Introduced by Pishchik in Trainable Activations for Image ClassificationThe Cosine Linear Unit, or CosLU, is a type of activation function that has trainable parameters and uses the cosine function.
$$CosLU(x) = (x + \alpha \cos(\beta x))\sigma(x)$$
Source: Trainable Activations for Image Classification
Papers
| Paper | Code | Results | Date | Stars |
|---|
Sigmoid Activation
