1 dataset found

Groups: Preference Optimization Organizations: No Organization Formats: JSON

Filter Results

  • Ultrafeedback

    The dataset used in the paper is Ultrafeedback, which is a preference dataset that contains 63k preference pairs sampled from models other than the SFT model.