Blenderbot模型汇总

下表汇总介绍了目前PaddleNLP支持的Blenderbot模型对应预训练权重。 关于模型的具体细节可以参考对应链接。

Pretrained Weight

Language

Details of the model

blenderbot-3B

English

26-layer, 32-heads, 3B parameters. The Blenderbot base model.

blenderbot-400M-distill

English

14-layer, 384-hidden, 32-heads, 400M parameters. The Blenderbot distil model.

blenderbot-1B-distill

English

14-layer, 32-heads, 1478M parameters. The Blenderbot distil 1B model.