Skip to content
Commit e5ba94ab authored by Liezl Puzon's avatar Liezl Puzon Committed by Facebook Github Bot
Browse files

Make TransformerEncoderLayer layer norm names more descriptive

Summary:
I added an upgrade_state_dict function so that loading old models will still work

layer_norms[0] --> self_attn_layer_norm
layer_norms[1] --> final_layer_norm

Reviewed By: pipibjc

Differential Revision: D14689849

fbshipit-source-id: b2809262c11fe9d083e571fa31044798aefd48ce
parent 309f2511
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment