Datasets Activity Stream About Order by Relevance Name Ascending Name Descending Last Modified Go 1 dataset found Tags: Direct Preference Optimization Filter Results Direct Preference Optimization With Unobserved Preference Heterogeneity The dataset used in the paper is a binary preference dataset from heterogeneous annotators. Dataset JSON