You're currently viewing an old version of this dataset. To see the current version, click here.

PANDA (Pedantic ANswer-correctness Determination and Adjudication)

Question answering (QA) can only make progress if we know if an answer is correct, but for many of the most challenging and interesting QA examples, current answer correctness (AC) metrics do not align with human judgments, particularly verbose, free-form answers from large language models.

Data and Resources

This dataset has no data

Cite this as

Zongxia Li, Ishani Mondal, Yijun Liang, Huy Nghiem, Jordan Boyd-Graber (2024). Dataset: PANDA (Pedantic ANswer-correctness Determination and Adjudication). https://doi.org/10.57702/p3mntyr3

Private DOI This DOI is not yet resolvable.
It is available for use in manuscripts, and will be published when the Dataset is made public.

Additional Info

Field	Value
Created	December 16, 2024
Last update	December 16, 2024
Defined In	https://doi.org/10.48550/arXiv.2402.11161
Author	Zongxia Li
More Authors	Ishani Mondal Yijun Liang Huy Nghiem Jordan Boyd-Graber