DistilBERT Model Summary

The following table summarizes the currently supported DistilBERT models and their corresponding pretrained weights in PaddleNLP. For detailed model specifications, please refer to the corresponding links.