You're currently viewing an old version of this dataset. To see the current version, click here.

CARETS: A Consistency And Robustness Evaluative Test Suite for VQA

CARETS is a systematic test suite to measure consistency and robustness of modern VQA models through a series of six fine-grained capability tests.

Data and Resources

This dataset has no data

Cite this as

Carlos E. Jimenez, Olga Russakovsky, Karthik Narasimhan (2025). Dataset: CARETS: A Consistency And Robustness Evaluative Test Suite for VQA. https://doi.org/10.57702/7idoamk9

Private DOI This DOI is not yet resolvable.
It is available for use in manuscripts, and will be published when the Dataset is made public.

Additional Info

Field	Value
Created	January 2, 2025
Last update	January 2, 2025
Defined In	https://doi.org/10.48550/arXiv.2203.07613
Author	Carlos E. Jimenez
More Authors	Olga Russakovsky Karthik Narasimhan
Homepage	https://github.com/princeton-nlp/CARETS