CTRL Model Summary

CTRL Model Summary#

The following table summarizes the CTRL models and corresponding pretrained weights currently supported by PaddleNLP.

English | 2-layer, 16-hidden, |
| 2-heads, 5M parameters. |
| The Tiny CTRL model. |