Language Modelling: WikiText-103

[dm-jrae]

Here is an update to the list for language modelling. The WikiText-103 dataset is not currently listed, but it has been a popular dataset for large vocabulary (not covered by ptb/wt2) and long time dependencies (not covered by billion word benchmark). It seems relevant for this list.

Paper title: Fast Parametric Learning with Activation Memorization
Dataset: WikiText-103
Metric: 29.2 (Perplexity)
Year: 2018
Link: https://arxiv.org/abs/1803.10049