6 datasets found

Robotic Videos dataset contains videos and corresponding user-to-robot textual commands.

Video generation is one of the most challenging tasks in Machine Learning and Computer Vision fields of study. In this paper, we tackle the text to video generation problem,...

Video Diffusion Models have been developed for video generation, usually integrating text and image conditioning to enhance control over the generated content.

The dataset used in the paper is MSR-VTT and UCF-101, two public datasets for video-text generation. MSR-VTT contains 4,900 videos with 20 manually annotated captions for each...

The dataset used in the paper for text-to-video diffusion models

The authors used the pre-trained diffusion-based text-to-video (T2V) generation model without additional fine-tuning.