Kevin Kleiner: Algorithm Interest Group on March 22, 2021
Exploring Stochastic Gradient Descent and its Modifications
Presentation Summary
In these slides, I present:
- Context and conceptual overview 2 of gradient descent and stochastic gradient descent
- Brief descriptions of modifications to SGD with visual comparisons 3
Examples
- SGD_Demos.ipynb using Kaggle height-weight data 5
References
- Kevin Kleiner: Algorithm Interest Group on March 22, 2021 · Exploring Stochastic Gradient Descent and its Modifications
- by Yubo "Paul" Yang · Linear Sum Assignment
- by Kevin Ly · PSLQ
- by Chad Germany · Simulated Annealing
- by Brian Busemeyer · BK-Tree
- by Brian Busemeyer · Simulated annealing
- by Brian Busemeyer · Cellular Automaton
- by Juha Tiihonen · Automatic focusing of cameras
- by Yubo "Paul" Yang · Particle Swarm Optimization
- by Brian Busemeyer · Evolutionary algorithms
ALGORITHM
optimization