FIT-AR: Far-reaching Interleaved Transformers for Autoregressive Modeling

We introduce FIT-AR, a variant of FIT that incorporates causal masks and shifting in cross-attention.

Data and Resources

Cite this as

Ting Chen, Lala Li (2024). Dataset: FIT-AR: Far-reaching Interleaved Transformers for Autoregressive Modeling. https://doi.org/10.57702/fszchq3g

DOI retrieved: December 2, 2024

Additional Info

Field Value
Created December 2, 2024
Last update December 2, 2024
Defined In https://doi.org/10.48550/arXiv.2305.12689
Author Ting Chen
More Authors
Lala Li
Homepage https://arxiv.org/abs/2206.09567