Pierce Freeman

Static typehinted languages can make us lazy about adding types at the right time.

In addition to the core language, code LLMs also have to interplay with an ecosystem of constantly changing dependencies.

Mountaineer 0.5.0 introduced database migration support, so you can now upgrade production databases directly from the CLI.

Midnight sun, camper van living, and fishing for cod in the Arctic islands where summer never ends.

Today I'm really excited to open source a beta of Mountaineer, an integrated framework to quickly build webapps in Python and React.

LLMs are by definition probabilistic; for each new input, they sample from a new distribution.

In the Vision Pro, there's sometimes a conflict between the window's existence and your own passthrough reality.

Why celebrating every small win dilutes the impact of truly meaningful accomplishments in workplace culture.

Most of the people I know in San Francisco have used a Waymo at least once.

I was doing some OSS benchmarking over the weekend and was running into an odd issue.

Cloud forests, surf towns, and learning that birding tours start at 5:30am for good reason.

Extensions are basically mini web applications these days, just with access to a `chrome` global variable that can interact with some browser-level functionality.

One issue I've occasionally observed on Runpod is varying runtime performance box-to-box.

I couldn’t write without footnotes.

In addition to forming a bulk of the foundation of modern language models, there's a ton of other data buried within Common Crawl.

How modern frameworks like Textual and Rich are bringing interactive UI experiences to the terminal with CSS-inspired layouts and component models.

Companies can add tech and policies to faciliate remote work.

Personal notes for where we're headed over the next 10 years.

flash-attention is a low level implementation of exact attention.

The real breakthrough with large language models might not be exceeding human levels of performance in a discrete task.

Working Pacific hours across both islands while chasing vineyards, empty beaches, and dolphins in the sounds.

One of my more memorable CV lectures in college opened with a declaration: representations in machine learning are everything.

Last weekend I spent some serious time with Siri for the first time in a couple years.

You can't iterate when you're building huge things.

By virtue of their training objective, LLMs are optimized to model language and minimize the perplexity of examples.

If you're using SQLAlchemy as your database ORM, there's a good chance you're using Alembic to migrate across revisions.

GPT-4 represents the latest leap in LLM sequence length.

Common wisdom says children explore while adults exploit.

Skiing the Sellaronda loop and eating pasta on mountain refugios during a low-snow year that still delivered.

Most of the grpc docs use the dynamic approach - I assume for ease of getting started.

The last few months have been tough for a lot of people.

It's 2023 and once again, we are all in on AI.

Celebrating Argentina's World Cup victory with 50,000 strangers while learning the blue market peso economy.

There are a series of resolution layers governing DNS, IP, and port routing on OSX.

A progress update on my second month of independent work.

A deep dive into debugging slow GPU utilization in a pytorch lightning training pipeline.

Copy and paste is ubiquitous.

Practical notes for debugging more complicated training pipelines and architectures, informed by pure research and productionalizing models in industry.

Ten days on the W Trek where your feet hurt for weeks but the glaciers make it worth every step.

Wine bars and empanadas in a city that deserves more than being treated as a Patagonia layover.

Five months on the road with an M1 MacBook, Canon R5, and the realization that laptop stands aren't worth the weight.

A revised comparison between GPU availability for AWS and GCP.

It's been a month since going full time on my own thing.

The logistics of booking Torres del Paine campsites before they sell out and choosing between Chilean and Argentine routes.

Given the pandemic's isolation of friends and friend groups, I've been thinking a lot about relationships.

There's a reason why dashboards have become increasingly common over the last decade.

Last week I said goodbye to my colleagues at Globality after five years on their engineering team.

Libraries might be one of the greatest assets in modern America.

Cloud compute is backed by physical servers.

Flawless trains, Alpine scrambles with rope assists, and cow bells echoing across valleys.