Skip to content
Commit 7e60d45b authored by Liezl Puzon's avatar Liezl Puzon Committed by Facebook Github Bot
Browse files

Support for BPE vocabs + denoising autoencoder in PyTorch Translate (#362) 

Summary:
Pull Request resolved: https://github.com/pytorch/fairseq/pull/362

Pull Request resolved: https://github.com/pytorch/translate/pull/254

This actually uses the fairseq logic which supports BPE cont / end word marker suffixes.

Reviewed By: xianxl

Differential Revision: D12952766

fbshipit-source-id: 35a1bbc38240e4145bec0fc419f2d0a6a73ae2e5
parent 880e7cd4
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment