Why Momentum Really Works

Aug 3, 2021 · #research · 阅读中文版

A very good article explaining how momentum in gradient descent helps with training.: https://distill.pub/2017/momentum/