Mathematical foundations of neural network weight optimization
Madhuri B. Thorat, Vaishali Pawan Wawage, Durga Prasad Yadav, P. Pushpalatha, Yatin Gandhi
In this paper: Neural network optimisation is a major problem in deep learning. It needs algorithms that work well with millions of parameters and keep convergence stable and generalisation. Stochastic gradient desc...
