DebertaV2模型汇总

下表汇总介绍了目前PaddleNLP支持的DebertaV2模型对应预训练权重。

Pretrained Weight	Language	Details of the model
deepset/deberta-v3-large-squad2	English	24-layer, 1024-hidden, 16-heads, 304M parameters. The deberta-v3-large model fine-tuned using the SQuAD2.0 dataset.
microsoft/deberta-v2-xlarge	English	24-layer, 1536-hidden, 24-heads, 900M parameters. The deberta-v2 model.
microsoft/deberta-v3-base	English	12-layer, 768-hidden, 12-heads, 86M parameters. The deberta-v2 model.
microsoft/deberta-v3-large	English	24-layer, 1024-hidden, 16-heads, 304M parameters. The deberta-v2 model.