From Dev.to
Too big, it explodes. Too small, it crawls.
The learning rate, step by step: why one number decides whether training works at all. Backpropagation tells every weight which way to move: its gradient. It doesn't say how far. That's the job of the...