#PyTorch

Technology

Optimizers Explained: SGD, Momentum, and Adam

Gradient descent tells you which way is downhill. The optimizer decides how to actually take the step. That distinction …