mBERT

Massively multilingual language models (mPLMs) such as mBERT (Devlin et al., 2019) and XLM-R (Conneau et al., 2020) have become the driving force for a variety of applications in multilingual NLP (Ponti et al., 2020; Hu et al., 2020; Moghe et al., 2022).