Parallel Iterative Edit Models for Local Sequence Transduction

Propose parallel iterative edit models for local sequence transduction. Introduce a framework consisting of two tasks: tagging, which chooses and arbitrarily reorders a subset of input tokens to keep, and insertion, which infills the missing tokens with another pretrained masked language model.