
0. Referencehttps://arxiv.org/abs/1609.04747 An overview of gradient descent optimization algorithmsGradient descent optimization algorithms, while increasingly popular, are often used as black-box optimizers, as practical explanations of their strengths and weaknesses are hard to come by. This article aims to provide the reader with intuitions with regaarxiv.org1. Introduction- Gradient Descent..