Understanding the Learning Rate: How Step Size Affects Neural Network Training (opens in new tab)

This is Day 11 of building a neural network from scratch. Yesterday we went over gradient descent: read the slope of the loss at your…