A Survey on recent activation functions with emphasis on oscillating activation functions
DOI:
https://doi.org/10.31224/2429Keywords:
Activation function, oscillating activation functionAbstract
The neural network learning and generalizing mechanisms of the brain have always intrigued scientists and researchers. Therefore, with the aim to mimic these “physiological workings” of the brain, the concept of using layers of artificial neurons (nodes) to make experienced predictions, accurate decisions, etc (Artificial neural network (ANN)) was introduced [ 5]. This paper briefly discusses few activation functions that have been used frequently over the years. In addition to that, the recent propositions regarding oscillating activation functions have been dealt with.
Downloads
Download data is not yet available.
Downloads
Posted
2022-06-25
License
Copyright (c) 2022 Bhavya Raitani
This work is licensed under a Creative Commons Attribution 4.0 International License.