95 datasets found

A multimodal dataset for machine learning tasks, focusing on Wikipedia-based image text datasets.

The ShapeNeRF–Text dataset consists of 40K paired NeRFs and language annotations for ShapeNet objects.

The MSVD-QA dataset is a benchmark for video question answering, containing 1,970 videos with multiple-choice questions.

The TGIF-QA dataset consists of 165165 QA pairs chosen from 71741 animated GIFs. To evaluate the spatiotemporal reasoning ability at the video level, TGIF-QA dataset designs...

A video-LLaMA model for video understanding, comprising 100k videos with detailed captions.

A video-based instruction dataset for video understanding, comprising 100k videos with detailed captions.

A large multi-modal instruction-following dataset for video understanding, comprising 37k conversation pairs, 26k complex reasoning QA pairs and 10k detail description...

The Hateful Memes dataset aims to help develop models that more effectively detect multimodal hateful content.

The dataset used in the paper is a set of sequential vision-and-language tasks, where each task consists of an image and a text input.

The dataset used in the paper for training and evaluation of the HYPE method.

Automatic evaluations for natural language generation (NLG) conventionally rely on token-level or embedding-level comparisons with the text references. This is different from...

The Hateful Memes dataset is a multimodal dataset containing 10,000+ new examples of multimodal content.

The Uniter dataset is a multimodal learning dataset, which consists of images and corresponding text.

The referring video object segmentation task (RVOS) involves segmentation of a text-referred object instance in the frames of a given video.

A multimodal variational autoencoder for low-cost cardiac hemodynamics instability detection from CXR and ECG.

The CSL dataset is a large-scale Chinese scientific literature dataset obtained from the "Qianyan" open-source NLP platform. It consists of 396,209 Chinese core journal papers'...

The MineCLIP dataset is a large-scale dataset of Minecraft demonstrations.

The dataset used in the paper is not explicitly described, but it is mentioned that the authors used a combination of reinforcement learning and generative models to solve...

PMC-CLIP: Contrastive language-image pre-training using biomedical documents.

BioMedClip: A CLIP model pretrained on image-text pairs extracted from PubMed Central repository.