BERT-XS: A Pre-trained Language Model for Chinese Long Documents

This paper proposes BERT-XS, a pre-trained language model for Chinese long documents.

BibTex: