research
∙
11/03/2022
Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively
Large-scale pre-trained language models have achieved impressive results...
share
research
∙
10/09/2022
Improve Transformer Pre-Training with Decoupled Directional Relative Position Encoding and Representation Differentiations
In this work, we revisit the Transformer-based pre-trained language mode...
research
∙
09/15/2019
