ARAGPT2

ARAGPT2 is a stacked transformer-decoder model trained using the causal language modeling objective. The model is trained on 77GB of Arabic text.

Data and Resources

Cite this as

Wissam Antoun, Fady Baly, Hazem Hajj (2024). Dataset: ARAGPT2. https://doi.org/10.57702/pmubdrtb

DOI retrieved: December 16, 2024

Additional Info

Field Value
Created December 16, 2024
Last update December 16, 2024
Defined In https://doi.org/10.48550/arXiv.2012.15520
Author Wissam Antoun
More Authors
Fady Baly
Hazem Hajj
Homepage https://github.com/aub-mind/arabert/tree/master/aragpt2