12 datasets found

The dataset used for training and testing the machine translation systems.

The dataset used for training and testing the Naive Bayes classifier for quality estimation of English-Hindi outputs.

XNMT is a neural machine translation toolkit that focuses on modular code design, making it easy to swap in and out different parts of the model.

A multilingual LLM for explaining and correcting translation errors

The dataset used for Vietnamese diacritic restoration problem, consisting of 180,000 sentence pairs.

The Zh-En multi-domain dataset consists of four balanced domains: news, patent, subtitles, and COVID-19.

The Machine Translation and Automated Analysis of the Sumerian Language dataset, which contains Sumerian texts in cuneiform script.

The MultiLexNorm dataset is used to evaluate the robustness of MT models to lexical normalization.

The MTNT dataset is used to evaluate the robustness of MT models to noisy text.

The FLORES-200 devtest dataset is used to evaluate the robustness of MT models to synthetic character perturbations.

The Covid-19 MLIA @ Eval initiative consists of three Natural Language Processing tasks: information extraction, multilingual semantic search and machine translation. The goal...

The Penn Treebank dataset contains one million words of 1989 Wall Street Journal material annotated in Treebank II style, with 42k sentences of varying lengths.