Search Engine Land » SEO » Transformer architecture ... The last part of the encoding (i.e., the last “hidden state”) was the context passed along to the decoder. In simple terms, the ...