Multimodal Contrastive Learning

The dataset used in the paper is a collection of pairs of observations (xi, ˜xi) from two modalities, where xi ∈ Rd1 and ˜xi ∈ Rd2. The dataset is used to evaluate the performance of multimodal contrastive learning (MMCL) on feature learning ability.