It is based on a transformer encoder-decoder architecture, where the encoder converts user input into a fixed-length latent representation, and the decoder generates output tokens from that ...

Mu uses a transformer encoder-decoder design, which means it splits the work into two parts. The encoder takes your words and turns them into a compressed form.