8 datasets found

The dataset used in the paper is a crowdsourcing task assignment dataset. It is a binary classification dataset with a sparse structure.

We consider 6 publicly available data sets, each consisting of labels provided by workers and the ground truth.

We consider the problem of accurately estimating the reliability of workers based on noisy labels they provide, which is a fundamental question in crowdsourcing.

Crowdsourcing dataset for airway annotations in chest CT images

The Dialog ESP Game is a crowdsourcing mechanism to acquire quality entity labels.

Breast cancer dataset where mammograms have been labeled independently by three doctors. Ground-truth has been obtained through a biopsy, not available to the algorithm nor the...

The dataset consists of synthetic, phonetically proximate options which emulate post-editing scenarios of varying difficulty for five languages: Arabic, German, Hindi, Russian,...

The dataset used in the paper to evaluate the performance of different information elicitation mechanisms.