Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation

A new GAN-based interactive image generation system for drawing objects from scratch that: 1) generates full images given partial user strokes (or sketches); 2) serves as a recommender system that suggests or helps the user during their creative process to help them generate a desired image; and 3) uses a single conditional GAN model for multiple image classes, via a gating-based conditioning mechanism.