RoFormer Models Summary

The following table summarizes the RoFormer models currently supported by PaddleNLP along with their corresponding pretrained weights. For detailed model architectures, please refer to the corresponding links.

| | Roformer English Small Generator. |