Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification (opens in new tab)
Unified Multimodal Modeling aims to integrate visual understanding and generation within a single system. However, existing approaches typically rely on two disparate visual tokenizers, which splits the representation space and hinders truly unified modeling. We propose UniAR, a unified autoregressive framework where a single discrete visual tokenizer serves as the key bridge between understanding and generation, enabling a shared context in whi...
Read the original article