ERNIE-M模型汇总¶
下表汇总介绍了目前PaddleNLP支持的ERNIE-M模型对应预训练权重。
Pretrained Weight |
Language |
Details of the model |
---|---|---|
|
Multilingual |
12-layer, 768-hidden, 12-heads, _M parameters. Trained on pseudo-parallel sentence pairs on a monolingual corpus. |
|
Multilingual |
24-layer, 1024-hidden, 16-heads, _M parameters. Trained on pseudo-parallel sentence pairs on a monolingual corpus. |