Ghost Attractor Networks: Basin-Structured Dynamical Decoders for Closed-Loop Sequential Generation (opens in new tab)
Sequential output generation with large-scale Transformer and diffusion decoders pays a memory cost that grows with sequence length, plus iterative per-step computation. Replacing them with small feed-forward decoders restores efficiency but produces unstructured latent representations that limit closed-loop control: phase-conditioned action generation and cross-step latent carry-over both require a latent geometry with stable basins. This artic...
Read the original article