Adam-mini: Use Fewer Learning Rates To Gain More

Arxiv Papers - Adam-mini: Use Fewer Learning Rates To Gain More