Skip to content
Commit 3e67386b authored by Lucio Dery's avatar Lucio Dery Committed by Facebook Github Bot
Browse files

Adafactor Optimizer (#472) 

Summary:
Pull Request resolved: https://github.com/pytorch/fairseq/pull/472

Implementation of "Adafactor: Adaptive Learning Rates with Sublinear Memory Cost" (https://arxiv.org/abs/1804.04235)

Differential Revision: D13388049

fbshipit-source-id: 24ad30f4bac248e6aeaced5064bb83784058f03d
parent 7e0d222c
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment