Browsing Department of Electrical Engineering by Subject "Adaptive activation functions"
Now showing items 1-2 of 2
-
ADAPTIVE ACTIVATIONS AND SHIFT INVARIANCE IN SHALLOW CONVOLUTIONAL NEURAL NETWORKS
(2021-08-13)Deep learning training training algorithms are a huge success in recent years in many fields including speech, text,image video etc. Deeper and deeper layers are proposed with huge success with resnet structures having ... -
MULTILAYER PERCEPTRON WITH ADAPTIVE ACTIVATION FUNCTIONS
(2016-05-26)A Multilayer perceptron typically has a fixed nonlinear activation function for each hidden unit. In this thesis, an adaptive activation function for individual hidden unit is designed, where the network learns these ...