learning Rates and How It Improves Performance in Deep Learning.pdf

Understanding Learning Rates and How It Improves Performance in Deep Learning This post is an attempt to document my understanding on the following topic: What is the learning rate? What is it’s signibcance? How does one systematically arrive at a good learning rate? Why do we change the learning rate during training? How do we deal with learning rates when using pretrained model?