Andrej Karpathy blog

This is a brief guide to my new art project microgpt, a single file of 200 lines of pure Python with no dependencies that trains and inferences a GPT.

The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some historical significance because it is, to my knowledge, the earliest real-world application of a neural net trained end-to-end with backpro…

I find blockchain fascinating because it extends open source software development to open source + state.

The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test.

Throughout my life I never paid too much attention to health, exercise, diet or nutrition.

Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets.

The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared.

This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad.

This is a long overdue blog post on Reinforcement Learning (RL).

The idea of writing a collection of short stories has been on my mind for a while.