Search
Now showing items 1-2 of 2
MULTILAYER PERCEPTRON WITH ADAPTIVE ACTIVATION FUNCTIONS
(2016-05-26)
A Multilayer perceptron typically has a fixed nonlinear activation function for each hidden unit. In this thesis, an adaptive activation function for individual hidden unit is designed, where the network learns these ...
ADAPTIVE ACTIVATIONS AND SHIFT INVARIANCE IN SHALLOW CONVOLUTIONAL NEURAL NETWORKS
(2021-08-13)
Deep learning training training algorithms are a huge success in recent years in many fields including speech, text,image video etc. Deeper and deeper layers are proposed with huge success with resnet structures having ...