research
∙
04/13/2022
Scalable Training of Language Models using JAX pjit and TPUv4
Modern large language models require distributed training strategies due...
share
research
∙
10/25/2021
No News is Good News: A Critique of the One Billion Word Benchmark
The One Billion Word Benchmark is a dataset derived from the WMT 2011 Ne...
research
∙
08/04/2021
