You're currently viewing an old version of this dataset. To see the current version, click here.

CARETS: A Consistency And Robustness Evaluative Test Suite for VQA

CARETS is a systematic test suite to measure consistency and robustness of modern VQA models through a series of six fine-grained capability tests.

Data and Resources

Cite this as

Carlos E. Jimenez, Olga Russakovsky, Karthik Narasimhan (2025). Dataset: CARETS: A Consistency And Robustness Evaluative Test Suite for VQA. https://doi.org/10.57702/7idoamk9

DOI retrieved: January 2, 2025

Additional Info

Field Value
Created January 2, 2025
Last update January 2, 2025
Defined In https://doi.org/10.48550/arXiv.2203.07613
Author Carlos E. Jimenez
More Authors
Olga Russakovsky
Karthik Narasimhan
Homepage https://github.com/princeton-nlp/CARETS