SIMMC: Situated Interactive Multi-Modal Conversational Data Collection and Evaluation Platform

doi:doi:10.57702/4jvg1qo0

SIMMC: Situated Interactive Multi-Modal Conversational Data Collection and Evaluation Platform

SIMMC is an extension to ParlAI for multi-modal conversational data collection and system evaluation. It simulates an immersive setup, where crowd workers interact with environments constructed in AI Habitat or Unity while engaging in a conversation.

BibTex:

@dataset{Paul_A_Crook_and_Shivani_Poddar_and_Ankita_De_and_Semir_Shaﬁ_and_David_Whitney_and_Alborz_Geramifard_and_Rajen_Subba_2024,
    abstract = {SIMMC is an extension to ParlAI for multi-modal conversational data collection and system evaluation. It simulates an immersive setup, where crowd workers interact with environments constructed in AI Habitat or Unity while engaging in a conversation.},
    author = {Paul A. Crook and Shivani Poddar and Ankita De and Semir Shaﬁ and David Whitney and Alborz Geramifard and Rajen Subba},
    doi = {10.57702/4jvg1qo0},
    institution = {No Organization},
    keyword = {'Conversational AI', 'Multi-Modal Data', 'Situated Behavior', 'Virtual Reality'},
    month = {dec},
    publisher = {TIB},
    title = {SIMMC: Situated Interactive Multi-Modal Conversational Data Collection and Evaluation Platform},
    url = {https://service.tib.eu/ldmservice/dataset/simmc--situated-interactive-multi-modal-conversational-data-collection-and-evaluation-platform},
    year = {2024}
}