GPT模型汇总#
下表汇总介绍了目前PaddleNLP支持的GPT模型对应预训练权重。 关于模型的具体细节可以参考对应链接。
Pretrained Weight |
Language |
Details of the model |
---|---|---|
|
Chinese |
32-layer, 2560-hidden, 32-heads, 2.6B parameters. Trained on Chinese text. |
|
Chinese |
12-layer, 768-hidden,
12-heads, 109M parameters.
The model distilled from
the GPT model |
|
English |
12-layer, 768-hidden, 12-heads, 117M parameters. Trained on English text. |
|
English |
24-layer, 1024-hidden, 16-heads, 345M parameters. Trained on English text. |
|
English |
36-layer, 1280-hidden, 20-heads, 774M parameters. Trained on English text. |
|
English |
48-layer, 1600-hidden, 25-heads, 1558M parameters. Trained on English text. |
|
English |
24-layer, 1024-hidden, 16-heads, 354M parameters. Trained on English text. Please refer to: microsoft/DialoGPT-medium |
|
Chinese |
12-layer, 768-hidden, 12-heads, 103M parameters. Trained on Chinese poetry corpus. Please refer to: uer/gpt2-chinese-poem |
|
English |
Please refer to: distilgpt2 |
|
Javanese |
Please refer to: w11wo/javanese-gpt2-small-imdb |
|
English |
Please refer to: remotejob/tweetsDISTILGPT2fi_v4 |
|
English |
Please refer to: TrLOX/gpt2-tdk |
|
English |
Please refer to: huggingtweets/slime_machine |
|
English |
Please refer to: microsoft/DialoGPT-small |
|
Russian |
Please refer to: sberbank-ai/rugpt3large_based_on_gpt2 |
|
English |
Please refer to: sshleifer/tiny-gpt2 |
|
English |
Please refer to: microsoft/DialoGPT-large |
|
Russian |
Please refer to: sberbank-ai/rugpt3small_based_on_gpt2 |
|
English |
Please refer to: uw-hai/polyjuice |
|
Hungarian |
Please refer to: NYTK/text-generation-poem-petofi-gpt2-small-hungarian |
|
English |
Please refer to: microsoft/DialogRPT-human-vs-rand |
|
English |
Please refer to: hf-internal-testing/tiny-random-gpt2 |
|
Russian |
Please refer to: Grossmend/rudialogpt3_medium_based_on_gpt2 |
|
English |
Please refer to: pranavpsv/genre-story-generator-v2 |
|
English |
Please refer to: microsoft/DialogRPT-updown |
|
English |
Please refer to: microsoft/DialogRPT-human-vs-machine |
|
Portuguese |
Please refer to: pierreguillou/gpt2-small-portuguese |
|
English |
Please refer to: mrm8488/GPT-2-finetuned-covid-bio-medrxiv |
|
German |
Please refer to: anonymous-german-nlp/german-gpt2 |
|
English |
Please refer to: microsoft/CodeGPT-small-py |
|
French |
Please refer to: antoiloui/belgpt2 |
|
German |
Please refer to: benjamin/gerpt2 |
|
French |
Please refer to: asi/gpt-fr-cased-small |
|
English |
Please refer to: microsoft/CodeGPT-small-java-adaptedGPT2 |
|
Dutch |
Please refer to: GroNLP/gpt2-small-dutch |
|
English |
Please refer to: lvwerra/gpt2-imdb |
|
Spanish |
Please refer to: DeepESP/gpt2-spanish |
|
English |
Please refer to: microsoft/CodeGPT-small-py-adaptedGPT2 |
|
English |
Please refer to: microsoft/DialogRPT-width |
|
French |
Please refer to: dbddv01/gpt2-french-small |
|
Italian |
Please refer to: GroNLP/gpt2-small-italian |
|
Persian |
Please refer to: flax-community/gpt2-medium-persian |
|
English |
Please refer to: microsoft/DialogRPT-depth |
|
English |
Please refer to: Nokia/nlgp-natural |
|
English |
Please refer to: macedonizer/hr-gpt2 |
|
English |
Please refer to: mrm8488/GPT-2-finetuned-common_gen |
|
English |
Please refer to: pranavpsv/gpt2-genre-story-generator |
|
English |
Please refer to: rbhushan/distilgpt2-finetuned-wikitext2 |
|
Romanian |
Please refer to: readerbench/RoGPT2-large |
|
Indonesian |
Please refer to: flax-community/gpt2-small-indonesian |
|
Persian |
Please refer to: HooshvareLab/gpt2-fa |
|
Indonesian |
Please refer to: cahya/gpt2-small-indonesian-522M |
|
English |
Please refer to: DingleyMaillotUrgell/homer-bot |
|
Spanish |
Please refer to: datificate/gpt2-small-spanish |
|
English |
Please refer to: ericzhou/tsundere_v1 |
|
English |
Please refer to: huggingtweets/wwm_shakespeare |
|
English |
Please refer to: SIC98/GPT2-python-code-generator |
|
Italian |
Please refer to: GroNLP/gpt2-small-italian-embeddings |
|
English |
Please refer to: huggingtweets/hel_ql-shahdashrf_-sinnerslayerr-witheredstrings |
|
English |
Please refer to: salesken/grammar_correction |
|
Indonesian |
Please refer to: flax-community/gpt2-medium-indonesian |
|
Turkish |
Please refer to: gorkemgoknar/gpt2-small-turkish |
|
English |
Please refer to: deepparag/DumBot |
|
Tagalog |
Please refer to: jcblaise/gpt2-tagalog |
|
English |
Please refer to: BigSalmon/InformalToFormalLincoln21 |
|
English |
Please refer to: LorenzoDeMattei/GePpeTto |
|
English |
Please refer to: macedonizer/sr-gpt2 |
|
English |
Please refer to: indonesian-nlp/gpt2 |
|
English |
Please refer to: ceostroff/harry-potter-gpt2-fanfiction |
|
Arabic |
Please refer to: akhooli/gpt2-small-arabic-poetry |
|
French |
Please refer to: asi/gpt-fr-cased-base |
|
English |
Please refer to: congcongwang/gpt2_medium_fine_tuned_coder |
|
English |
Please refer to: cambridgeltl/simctg_wikitext103 |