# Eve: A Gradient Based Optimization Method with Locally and Globally Adaptive Learning Rates Source: [Eve: A Gradient Based Optimization Method with Locally and Globally Adaptive Learning Rates]() Collection index: [llms.txt]() Data updated: 2025-10-25T21:05:03.439Z Authors: Hiroaki Hayashi, Jayanth Koushik, Graham Neubig Published: 2016-11-04T19:42:45.000Z ## Abstract Adaptive gradient methods for stochastic optimization adjust the learning rate for each parameter locally. However, there is also a global learning rate which must be tuned in order to get the best performance. In this paper, we present a new algorithm that adapts the learning rate locally for each parameter separately, and also globally for all parameters together. Specifically, we modify Adam, a popular method for training deep learning models, with a coefficient that captures properties of the objective function. Empirically, we show that our method, which we call Eve, outperforms Adam and other popular methods in training deep neural networks, like convolutional neural networks for image classification, and recurrent neural networks for language tasks. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. ## Original sources and implementation [Original paper]() [PDF]()