Fig. 2: Optimizer loss comparison.
Comparison of Adam and Lion optimizer loss with varying a learning rates and b weight decays.
Fig. 2: Optimizer loss comparison. | npj Heritage Science
Comparison of Adam and Lion optimizer loss with varying a learning rates and b weight decays.
