Part 9 · The Papers & Sources

Suggested reading order

Start with Attention Is All You Need for the mechanism, then Chinchilla for the economics, then FlashAttention for how systems thinking changes an algorithm without changing its output. If you are implementing rather than reading, do CS336’s assignments in order instead — the papers make much more sense after you have written the thing.