Cross-attention

Quick meaning: Cross-attention is a noun meaning (machine learning) A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

Meaning

(machine learning) A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

Example Sentences

The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]

Antonyms for cross-attention

Common opposites include self-attention.

Related Dictionary Tools