In encoder-decoder architectures, the outputs on the encoder blocks act as the queries to your intermediate representation