45 datasets found

The LLaVA 158k dataset is a large-scale multimodal learning dataset, which is used for training and testing multimodal large language models.

The MMR benchmark is designed to evaluate MLLMs' comprehension of visual content and robustness against misleading questions, ensuring models truly leverage multimodal inputs...

Multi-ZOL is a Chinese dataset for Target-oriented Multimodal Sentiment Classification (TMSC). The dataset contains text and image data, where the text data is used to determine...

Twitter15 and Twitter17 are two English datasets for Target-oriented Multimodal Sentiment Classification (TMSC). The datasets contain text and image data, where the text data is...

Openclip: A large-scale multimodal dataset for vision and language understanding.

Degree datasets are constructed by gradually adjusting the degree of alignment between image and text.

Caption MNIST is a synthetic image-text pair dataset built by filling in the missing colors, digits, and positions in the MNIST dataset.

The XD-Violence dataset is a large-scale multimodal video dataset for violence detection. It consists of 4,754 untrimmed videos with a total duration of 217 hours, covering six...

TCGA-OMICS: A comprehensive dataset of genomic, transcriptomic, and proteomic data from The Cancer Genome Atlas Program

MUGEN-GAME: A large-scale and multimodal dataset for video-audio-text multimodal understanding and generation

Video question answering (VideoQA) requires systems to understand the visual information and infer an answer for a natural language question from it.

InternVid: A large-scale video-text dataset for multimodal understanding and generation.

WanJuan: A comprehensive multimodal dataset for advancing English and Chinese large models.

Crisscrossed Captions (CxC) dataset is a multimodal learning dataset used for training and evaluation of the MURAL model.

Wikipedia Image Text (WIT) dataset is a large-scale multimodal learning dataset used for training and evaluation of the MURAL model.

Multimodal, Multitask Retrieval Across Languages (MURAL) dataset is used for training and evaluation of the MURAL model.

EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge

Development dataset for multimodal beam prediction challenge

Multimodal transformer deep learning framework for sensing-assisted beam prediction in wireless communications

Video question answering task, which requires machines to answer questions about videos in a natural language form.