Funnel模型汇总#

下表汇总介绍了目前PaddleNLP支持的Funnel模型对应预训练权重。 关于模型的具体细节可以参考对应链接。

Pretrained Weight

Language

Details of the model

funnel-transformer/small

English

For details, please refer to: funnel-transformer/small

funnel-transformer/small-base

English

For details, please refer to: funnel-transformer/small-base

funnel-transformer/meduim

English

For details, please refer to: funnel-transformer/meduim

funnel-transformer/meduim-base

English

For details, please refer to: funnel-transformer/meduim-base

funnel-transformer/intermediate

English

For details, please refer to: funnel-transformer/intermediate

funnel-transformer/intermediate-base

English

For details, please refer to: funnel-transformer/intermediate-base

funnel-transformer/large

English

For details, please refer to: funnel-transformer/large

funnel-transformer/large-base

English

For details, please refer to: funnel-transformer/large-base

funnel-transformer/xlarge

English

For details, please refer to: funnel-transformer/xlarge

funnel-transformer/xlarge-base

English

For details, please refer to: funnel-transformer/xlarge-base