Setting the learning rate to a high value will always lead to faster convergence.
☐
Setting the learning rate to a low value might lead to sub-optimal solution.
It is better to have the same learning rate for all the epochs.
It is possible to schedule the learning rate and change it while model training.
Fig: 1