Torsten Hoefler's blog

Let’s Stop Calling Everything “Linear Attention” If your “constant-time” attention still scans a million tokens, we need to talk.

A modest proposal for saving scientific computing from typographic entropy.

I am traveling to the US often enough that it pays off to have a local phone number.

SPCL is back at SC – after a forceful break last year where we could not submit because I was technical papers co-chair, we celebrate our comeback this year (with some backlog from las of course).

This blog post purely reflects my personal opinions even though it happened during business travel on behalf of ETH, it has nothing to do with the university.

Twelve ways to fool the masses when reporting performance of deep learning workloads Torsten Hoefler Due to it’s wide-spread success in many hard machine learning tasks, deep learning quickly became one of the most important demanding compute workloads to…

The OFA just released a new Open Subnet Manager version (v3.3.21) for InfiniBand, including many interesting features: Support for HDR link speed and 2x link width New routing algorithm: Nue routing Support for ignoring of throttled links for Nue [1,2] and

Just a brief overview of SPCL’s (non-NDA) ongoing and upcoming activities at ISC’18. 1) We’re in the middle of the Advanced MPI Tutorial With Antoni Pena from Barcelona Supercomputing Center, Tweet 2) Wednesday, 26.06., 11:15am, Talk: Automatic compiler-d…

Disclaimer: This blog post is not binding for the SC18 submission process.

SC17 is over, and even though it was my 10th anniversary, it wasn’t the best of the SC series.