MegatronBert模型汇总#
下表汇总介绍了目前PaddleNLP支持的MegatronBert模型对应预训练权重。 关于模型的具体细节可以参考对应链接。
Pretrained Weight |
Language |
Details of the model |
|---|---|---|
|
English |
For details, please refer to: nvidia/megatron-bert-cased-345m |
|
English |
For details, please refer to: nvidia/megatron-bert-uncased-345m |