1 dataset found

Groups: Preference Alignment Organizations: No Organization

Filter Results

  • Ultrafeedback

    The dataset used in the paper is Ultrafeedback, which is a preference dataset that contains 63k preference pairs sampled from models other than the SFT model.