ATTENTION GLYPH

A UNIFIED VIEW OF INFORMATION FLOW ACROSS A SET OF VECTORS.

A = \operatorname{softmax}\left(\frac{QK^T}{\sqrt{d_k}}\right)

d_model = 768 n_heads = 12 seq_len = 1024

x = A\,\sin(at + \delta)

y = B\,\sin(bt)

a = 3 \qquad b = 2 \qquad \delta = \pi/2

a = 3 \quad b = 2 \quad \delta = \pi/2

\theta = n\varphi

r = c\sqrt{n}

\varphi = (1 + \sqrt{5}\,)\ /\ 2

F(x,\ y) = (\,-y,\ x\,)

\nabla \cdot F = 0

x = A\,\sin(at + \delta)

\textstyle\sum_t\ w_t\, x_t

LATENTHow AI Works

Motion Design Style-Frame Book

A VISUAL EXPLORATION OF THE MATHEMATICS, MECHANISMS AND BEAUTY BEHIND MODERN ARTIFICIAL INTELLIGENCE.