CTRL Model Summary#
The following table summarizes the CTRL models and corresponding pretrained weights currently supported by PaddleNLP.
English | 2-layer, 16-hidden, |
| 2-heads, 5M parameters. |
| The Tiny CTRL model. |