PANDA (Pedantic ANswer-correctness Determination and Adjudication)

Question answering (QA) can only make progress if we know if an answer is correct, but for many of the most challenging and interesting QA examples, current answer correctness (AC) metrics do not align with human judgments, particularly verbose, free-form answers from large language models.

Data and Resources

Cite this as

Zongxia Li, Ishani Mondal, Yijun Liang, Huy Nghiem, Jordan Boyd-Graber (2024). Dataset: PANDA (Pedantic ANswer-correctness Determination and Adjudication). https://doi.org/10.57702/p3mntyr3

DOI retrieved: December 16, 2024

Additional Info

Field Value
Created December 16, 2024
Last update December 16, 2024
Defined In https://doi.org/10.48550/arXiv.2402.11161
Author Zongxia Li
More Authors
Ishani Mondal
Yijun Liang
Huy Nghiem
Jordan Boyd-Graber