-
- Downloads
Open Source MLM Implementation in Fairseq (#635)
Summary: Pull Request resolved: https://github.com/pytorch/fairseq/pull/635 Adding a task and relevant models, datasets and criteria needed for training Cross-lingual Language Models similar to Masked Language Model used in XLM (Lample and Conneau, 2019 - https://arxiv.org/abs/1901.07291). Reviewed By: liezl200 Differential Revision: D14943776 fbshipit-source-id: 3e416a730303d1dd4f5b92550c78db989be27073
Showing
- examples/cross_lingual_language_model/README.md 76 additions, 0 deletionsexamples/cross_lingual_language_model/README.md
- fairseq/criterions/masked_lm_loss.py 148 additions, 0 deletionsfairseq/criterions/masked_lm_loss.py
- fairseq/data/masked_lm_dataset.py 358 additions, 0 deletionsfairseq/data/masked_lm_dataset.py
- fairseq/data/masked_lm_dictionary.py 60 additions, 0 deletionsfairseq/data/masked_lm_dictionary.py
- fairseq/data/multi_corpus_sampled_dataset.py 187 additions, 0 deletionsfairseq/data/multi_corpus_sampled_dataset.py
- fairseq/models/masked_lm.py 297 additions, 0 deletionsfairseq/models/masked_lm.py
- fairseq/tasks/cross_lingual_lm.py 161 additions, 0 deletionsfairseq/tasks/cross_lingual_lm.py
Loading
Please register or sign in to comment