no code implementations • 15 Oct 2022 • Feihu Han, Sida Xing, Sui Yang Khoo
There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the iteration.
no code implementations • 2 Aug 2021 • Jordan Inturrisi, Sui Yang Khoo, Abbas Kouzani, Riccardo Pagliarella
We demonstrate how PiLU is a generalised rectifier unit and note its similarities with the Adaptive Piecewise Linear Units, namely adaptive and piecewise linear.