Jacob’s Blog

This journal was transcribed from handwritten notebook pages.

When the Nazis came for the communists, I kept quiet; I wasn’t a communist.

Over the past few months, I helped develop Gradient Routing, a non loss-based method to shape the internals of neural networks.

Produced as part of the MATS Summer 2024 program, under the mentorship of Alex Turner.

Do you ever go to a lecture, follow it thinking it makes total sense, then look back at your notes later and realize it makes no sense?

I did Quiz Bowl throughout my time in high school, and looking back on it, it was a pretty positive thing to do!

Problem “You’ll have a great time wherever you go to college!”

In Unix, everything is a file; in set theory, everything is a set.

[Epistemic Status: Wrote this as an ‘argument paper’ for English class.

When I saw the following equation in the attribution patching paper, I got really confused and spent a bunch of time thinking about it: \[L(x_\text{clean} | \operatorname{do}{(E = e_\text{corr})}) \approx L(x_\text{clean}) + (e_\text{corr} - e_\text{clean…