Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning
For overparameterized optimization tasks, such as those found in modern machine learning, global minima are generally not unique. In order to understand generalization in these settings, it is vital to study to which minimum an optimization algorithm converges. The possibility of having…
