CTRL Model Summary#

The following table summarizes the CTRL models and corresponding pretrained weights currently supported by PaddleNLP.

English | 2-layer, 16-hidden, |

| 2-heads, 5M parameters. |