Synthesis Step by Step (S3)

Data Synthesis is a promising way to train a small model with very little labeled data. One approach for data synthesis is to leverage the rich knowledge from large language models to synthesize pseudo training examples for small models, making it possible to achieve both data and compute efficiency at the same time.

Data and Resources

Cite this as

Ruida Wang, Wangchunshu Zhou, Mrinmaya Sachan (2025). Dataset: Synthesis Step by Step (S3). https://doi.org/10.57702/3g4oxv9y

DOI retrieved: January 2, 2025

Additional Info

Field Value
Created January 2, 2025
Last update January 2, 2025
Defined In https://doi.org/10.48550/arXiv.2310.13671
Author Ruida Wang
More Authors
Wangchunshu Zhou
Mrinmaya Sachan