Home on Senthilnathan

the first thing my language model wrote that looked like a sentence was: the little red fox ran home.o..ittle red fox ran home.o..ittle red fox r i was happy about the first part. less happy about the rest. there was no attention in this model. no transfo…

when i started this, i thought inference was basically this: while True: logits = model(tokens) token = logits[-1].argmax() tokens.append(token) which is correct. technically. but, this tells us nothing about what happens when two people use the model at…

if you’ve spent time in both systems programming and ML infrastructure, you get this weird deja vu reading about transformer inference. the words are new.

i’ve used PyTorch for years. a @ b, .backward(), .cuda(). works every time. i never thought about what’s underneath. then i came across tinygrad. it’s the deep learning stack behind comma.ai’s openpilot, the open-source self-driving system. 17K lines of P…

void *p = malloc(13); Almost all of us has seen this before when writing a safe c program. we know what this line does, atleast we know the purpose of it, ask for 13 bytes, get 13 bytes that’s what i thought when i started building this on a friday out of…

i spend every week doing something that has absolutely nothing to do with putting out good content for my blog. i am fixing a transitive dependency vulnerability in a package i didn’t even know i was using. for a solo developer, the javascript ecosystem c…

Sometimes I wish that I had something to stick onto like a niche or a skill that I can keep doing for the rest of my life.

an FPGA engineer recently used a tamil movie analogy to explain hardware design, and it fundamentally changed how i approach programming. he compared FPGAs to Anniyan-the chaotic protagonist with three personalities: ambi: strict, rule-bound bureaucrat an…

i was literally screaming my lungs out - “AKAZAAAAA” - along with the protagonist when akaza showed up before tanjiro in the Demon Slayer: Infinity Castle but something about their battle lingered. apart from the mind-blowing effort put into the animation,

Welcome!