Out of Distribution

No training anywhere: a compiler sets the weights of a stock Phi-3-architecture checkpoint so autoregressive generation executes Doom's classic renderer.

Setting a transformer's weights by hand -- no training -- to build four exact calculators and compare how they use layers, parameters, and generated tokens.

A compiler that turns computation graphs into the weights of a stock transformer -- no training anywhere.

The MNIST digits a simple convnet gets wrong, and what they suggest about how the state of the art compares to human performance.