Alex's Blog

LLMs typically use some sort of positional encoding for helping the model understand where different tokens (or more precisely, KV cache entries) are.

Unconditional love is a very talked-about but much misunderstood concept.

I saw [a post](https://x.com/DimitrisPapail/status/2024555561199480918?

Audiobooks vs. physical books, many go as far as to say vs. real reading, I do not, I'll try to explain why.

Being stubborn and how stubborn to be is an extremely important ethical question.

Morality is divided broadly between deontologists and utilitarians.

I read the book Determined by Robert Sapolsky and disagreed with the core thesis on numerous accounts.

Since I was a child I have had a great fear perhaps my greatest fear of living a tale that has already been told.

Peter Thiel praises contrarianism why?

We are all faced with a problem, we order some chips and guac or some chips and salsa and once we get towards the end of the dip we must resort to a sort of scrapping to most efficiently get at what r...

I like to listen to audiobooks and podcasts at several times speed.

People talk often about privacy.

Causality runs forward in time right?

It is bad for agents to act against their values.

Normally ASR is measure by edit distance measured in words or charecters (also refered to as levenstien distance).

I was struck reading some materials on cognitive biases [Allias paradox](https://www.lesswrong.com/posts/zJZvoiwydJ5zvzTHK/the-allais-paradox) specifically not by the existence of the bias but by the ...

You want to diversify to maximize your expected return.

I made a bookcase.

The problem with counterfactuals is they can be counterfactual

Why is indoor humidity so low in the winter?

If you really hate running it is probably because your cardio is bad or because you are going way to hard or both

So you want to make a lava lamp what shape?