The Linear Combination of Activations, or LinComb, is a type of activation function that has trainable parameters and uses the linear combination of other activation functions.
$$LinComb(x) = \sum\limits_{i=0}^{n} w_i \mathcal{F}_i(x)$$
Source: Trainable Activations for Image ClassificationPaper | Code | Results | Date | Stars |
---|
Component | Type |
|
---|---|---|
ReLU
|
Activation Functions | (optional) |
Sigmoid Activation
|
Activation Functions | (optional) |
Softsign Activation
|
Activation Functions | (optional) |
Tanh Activation
|
Activation Functions | (optional) |