-
A crowd-sourced frame disambiguation corpus with ambiguity
A crowd-sourced frame disambiguation corpus with ambiguity. -
Crowdsourcing task assignment dataset
The dataset used in the paper is a crowdsourcing task assignment dataset. It is a binary classification dataset with a sparse structure. -
Crowdsourcing datasets
We consider 6 publicly available data sets, each consisting of labels provided by workers and the ground truth. -
A Minimax Optimal Algorithm for Crowdsourcing
We consider the problem of accurately estimating the reliability of workers based on noisy labels they provide, which is a fundamental question in crowdsourcing. -
Early Experiences with Crowdsourcing
Crowdsourcing dataset for airway annotations in chest CT images -
oDesk dataset
The dataset used in the paper is a crowdsourcing dataset with 200 workers and 10 tasks. Each worker has a set of skills and each task has a set of required skills. The dataset... -
Dialog ESP Game
The Dialog ESP Game is a crowdsourcing mechanism to acquire quality entity labels. -
POAPS Program for Find-Fix-Verify
A POAPS program for finding-fix-verify -
POAPS Program for Iterative Improvement
A POAPS program for iterative improvement on descriptions for images -
POAPS Program for Labeling
A POAPS program for labeling that manages uncertainty without exposing it to the user -
A Programming Language With a POMDP Inside
A programming language with a POMDP inside -
MRC Harwell Mouse Behaviour Dataset
The dataset is a social behaviour-phenotyping data-set for caged mice, obtained from the Medical Research Council, Harwell Institute, Oxfordshire (MRC Harwell) as documented in... -
Reputation Agent: Prompting Fair Reviews in Gig Markets
Reputation Agent is a tool that detects unfair reviews on gig markets and prompts fairer assessments by presenting micro-information about gig workers’ conditions and policies. -
Good Judgment Open
The Good Judgment Open (GJO) dataset contains 1770 datapoints (698 'forecasts' and 1072 'comments') posted by 242 anonymised users with a range of expertise. -
Breast Cancer Dataset
Breast cancer dataset where mammograms have been labeled independently by three doctors. Ground-truth has been obtained through a biopsy, not available to the algorithm nor the... -
Feasibility of Post-Editing Speech Transcriptions with a Mismatched Crowd
The dataset consists of synthetic, phonetically proximate options which emulate post-editing scenarios of varying difficulty for five languages: Arabic, German, Hindi, Russian,... -
Spot Check Equivalence
The dataset used in the paper to evaluate the performance of different information elicitation mechanisms. -
CRWIZ: A Framework for Crowdsourcing Real-Time Wizard-of-Oz Dialogues
A crowdsourced dialogue dataset for emergency response tasks, using a Wizard-of-Oz approach. -
An End-to-End Deep RL Framework for Task Arrangement in Crowdsourcing Platforms
A Deep Reinforcement Learning framework for task arrangement in crowdsourcing platforms.
