7 datasets found

TimeIT is a video-centric instruction-tuning dataset designed for instruction tuning. It is composed of 6 diverse tasks, 12 widely-used academic benchmarks, and a total of 125K...

QVHighlights is a dataset for video highlight detection, which consists of over 10,000 videos annotated with human-written text queries.

The TGIF-QA dataset consists of 165165 QA pairs chosen from 71741 animated GIFs. To evaluate the spatiotemporal reasoning ability at the video level, TGIF-QA dataset designs...

A video-LLaMA model for video understanding, comprising 100k videos with detailed captions.

A video-based instruction dataset for video understanding, comprising 100k videos with detailed captions.

A large multi-modal instruction-following dataset for video understanding, comprising 37k conversation pairs, 26k complex reasoning QA pairs and 10k detail description...

The dataset used in the paper is MSR-VTT, a large video description dataset for bridging video and language. The dataset contains 10k video clips with length varying from 10 to...