43 datasets found

MTG is a multilingual multiway text generation benchmark suite. It is the first-proposed multilingual multiway text generation dataset with the largest human-annotated data...

The PMIndiaSum dataset contains multilingual and cross-lingual headline summarization for languages in India.

Wikipedia as multilingual source of comparable corpora.

The M4 dataset consists of human-written texts from several data sources, including Wikipedia, Reddit, and arXiv in the English subset of the dataset. It pairs the human-written...

The CLIPfa dataset is a multilingual image-text dataset.

The SemEval-2023 Visual Word Sense Disambiguation (V-WSD) Task dataset consists of a silver dataset with 12,869 V-WSD instances. Each sample is a 4-tuple ⟨f, c, I, i∗ ∈ I⟩ where...

The PAN Profiling Fake News Spreader Task contains a dataset in English, whose samples were collected from Twitter.

The PAN Profiling Hate Speech Spreader Task contains a dataset in English and Spanish, whose samples were collected from Twitter.

The BABEL-Pashto dataset is a multilingual speech recognition dataset containing Pashto speech recordings.

A multilingual African embedding for FAQ chatbots

Multilingual Neural Machine Translation datasets

The dataset used in this study is the OSCAR corpus, which is a multilingual corpus that is obtained by filtering of the Common Crawl corpus.

A collection of semantic textual relatedness datasets for African and Asian languages.

A collection of semantic textual relatedness datasets for 14 languages.

This work showcases a cost-effective method for generating training data for speech processing tasks. The dataset MCV-10 is a multilingual dataset that contains 50 hours of...

Translated dataset for Multilingual Coreference Resolution (TransMuCoRes) in 31 South Asian languages.

The DBP15KZH-EN, DBP15KJA-EN, and DBP15KFR-EN datasets are used for cross-lingual entity alignment. The datasets contain entities, relations, and attributes, and are used to...

Multilingual text classification dataset with 17 different languages

The MARC dataset is a multilingual text classification dataset that contains 6 languages.

MEANTIME, the NewsReader Multilingual Event and Time Corpus.