42 datasets found

Multilingual CommonsenseQA (mCSQA) is a dataset for evaluating the common sense reasoning capabilities of multilingual LMs.

The MGSM dataset is a multilingual math reasoning dataset containing around 7,500 training samples and 1,319 testing samples.

The mCoT-MATH dataset is a large-scale multilingual math CoT reasoning dataset containing around 6.3 million samples in eleven diverse languages.

A multilingual version of the seq2seq architecture trained on Colossal Clean Crawled Corpus.

The ConceptNet 5.5 dataset is an open multilingual graph of general knowledge.

Parameter-efficient fine-tuning (PEFT) using labeled task data can significantly improve the performance of large language models (LLMs) on the downstream task. However, there...

A dataset of historical texts in eight languages, used for historical spelling normalization.

A multilingual stance detection dataset XArgMining from the IBM Debater project contains human-authored data points for stance detection in English, as well as such data points...

A multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants.

The BabelSememe dataset is a multilingual sememe knowledge base built on BabelNet, containing over 15 thousand BabelNet synsets manually annotated with sememes.

A high-quality dataset in English and 12 other languages, augmented with rhyme schema at the paragraph level.

A dataset and baselines for multilingual reply suggestion.

A multilingual open-domain dialogue evaluation benchmark featuring 14930 annotated turns and 8691 dialogues in 10 languages.

The dataset is a multilingual offensive language identification dataset for social media, containing posts from Arabic, Danish, English, Greek, and Turkish.

The Multilingual Eye-movement Corpus (MECO) is a collection of eye-tracking data that has been collected from participants reading texts in 13 languages.

DiS-ReX: A multilingual dataset for distantly supervised relation extraction.

Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources...

MuLiMa is a multilingual dictionary of mathematics curated by mathematicians.

The Xl-sum dataset for multilingual abstractive summarization

The Cross-Lingual Ability of Multilingual BERT dataset