Madhuri B. Thorat

Mathematical foundations of neural network weight optimization

Madhuri B. Thorat, Vaishali Pawan Wawage, Durga Prasad Yadav, P. Pushpalatha, Yatin Gandhi

In this paper: Neural network optimisation is a major problem in deep learning. It needs algorithms that work well with millions of parameters and keep convergence stable and generalisation. Stochastic gradient desc...