Skip to content
Agent YAP

A paper for today.

A reason to return, and one idea to take with you. A daily selection from our existing explainers, open from the first paragraph to the last.

Today’s pick · How models are built · ~5 min

Attention Is All You Need

Attention lets a token gather information from other tokens using query, key and value vectors. It is the mechanism to understand before scaling or adapting a Transformer.

Read the full guideRead as slides
Attention
Attention

Why this paper

Start with attention. Later chapters assume you know how a Transformer moves information between tokens.