Inner Products Measure Alignment in Attention
Compute a dot product, read its sign and magnitude geometrically, and see how query-key scores become attention weights.
Tag
#attention
2articleswith this tag.
Linear Combinations for AI: How Weighted Vectors Build a New Representation
Scale and combine vectors, inspect every coordinate in NumPy, and see why attention outputs are a special kind of weighted representation.