Deschide articolul original într-un tab nou Schimbarea acestei opțiuni se aplică imediat și reîncarcă pagina.
LECTURA
← Înapoi la Urmăritori

Noah Golmant

noahgolmant.com/rss.xml
Vizitează site-ul

Cel mai recent articol

Ultima verificare

Urmăritori 0 urmăritori
Articole: 7

  1. The local shape of LLM stable regions

    (Noah Golmant)

    Most of the time at inference, the Fisher pullback through the unembedding tells you exactly how far you can perturb the residual stream before the predictive distribution moves — and it's literally the second-order Taylor expansion of KL.

  2. Revisiting pytorch-hessian-eigenthings, eight years later

    (Noah Golmant)

    A v1.0 rewrite of my old curvature analysis library: new operators, new algorithms, and a lot of numerical validation I should have written the first time.

  3. Dynamical systems and an abstract view of autoregressive transformers

    (Noah Golmant)

    Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricks

  4. Autoregressive transformers and lessons from enactivism

    (Noah Golmant)

    Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricks

  5. Fine-tuned noise

    (Noah Golmant)

    Studying the covariance structure of mini-batch noise in stochastic gradient descent

  6. Meta-learning and optimization

    (Noah Golmant)

    MAML Hunting

  7. First-order methods almost always avoid saddle points

    (Noah Golmant)

    An application of dynamical systems theory to optimization