English word
attention
/əˈtɛn.ʃn̩/CEFR level: A2, Elementary
Meanings
noun
Mental focus.
Example: Please direct your attention to the following words.
An action or remark expressing concern for or interest in someone or something, especially romantic interest.
Example: She attended her sickbed; her watchful attentions triumphed over the malignity of the distemper.
A state of alertness in the standing position.
Example: The company will now come to attention.
A kind of prioritisation technique in neural networks that assigns soft weights between tokens from two (or more) input sequences in order to compute the required output.
Example: The attention mechanism is an important part of these models and plays a very crucial role. Before Transformer models, the attention mechanism was proposed as a helper for improving conventional DL models such as RNNs.