GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives

Human annotation plays a core role in machine learning — annotations for supervised models, safety guardrails for generative models, and human feedback for reinforcement learning, to cite a few avenues. However, the fact that many of these human annotations are inherently subjective is often overlooked.

BibTex: