plugyawn's blog(?)

First there were humans, and then there was Abundance.

Strong architectures are results of accidental/intentional hardware-software codesign.

Per SICP, a computer program is defined as the precise description of a process.

I have always been fascinated by those wizardly folks who seem to know how to talk to their PID controllers, hold it for seconds and tune it nearly perfectly.

Do these jokes still work?

This blog probes and develops the idea of distributed training of large models over heterogeneous devices.

Towards a Theory for Large Language Models from Across the Internet A concrete theory for large language models must start with the phenomenon that resulted in the notion that such large models could exist.