Skip to content
Commit b2374e52 authored by Alexei Baevski's avatar Alexei Baevski Committed by Myle Ott
Browse files

caching v3 (cache keys, values, process only last time step) (#241) 

- process only last time step during generation
- cache keys and values
- dont apply masking during generation
parent 81b47e7e
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment