Ehsan's Blog

It’s Finally Done After almost six years, createlang.rs is complete.

The Paper Alright, so I finally finished writing this up.

Mojo GPU Puzzles Edition 1 is out.

I wrote a post on the Modular blog about two optimizations that just landed in MAX Serve: paged attention and prefix caching.

I wrote a post on the Modular blog about building AI agents with MAX Serve and OpenAI-style function calling.

I wrote a hands-on post on the Modular blog about Mojo 24.6.

I wrote a tutorial on the Modular blog that builds a chat interface on top of Llama 3 and MAX Serve, end to end.

I wrote a post on the Modular blog about two optimizations that just landed in MAX Serve: paged attention and prefix caching.

I wrote a hands-on post on the Modular blog about Mojo 24.5.

I wrote the MAX 24.4 release post on the Modular blog.

I wrote a post on the Modular blog about ownership, mostly in the context of Mojo.

I wrote a post over on the Modular blog about building semantic search with MAX Engine.

Prelude In this post, we’re going to deep dive into one of my favourite tools that are revolutionizing how Python code is run in cloud and it’s especially aimed at the computing stack for Machine Learning / Deep Learning applications, called Modal which h…

Over the past year, perhaps the most cited paper across the software industry is Attention is All You Need that is at the heart of ChatGPT and GPT transformer models.

Prelude In the Rust world, the interaction between Python and Rust is very well-known through the amazing PyO3 ecosystem.

This post tries to shed some light on the rapidly changing LLM frameworks in particular, LangChain (LC) and Llama-index (LI).

DLPack is the standard in-memory data format that facilitateszero-costtensor transfer across major Deep Learning frameworks (PyTorch, TensorFlow and TVM) and the supported Python Array processing frameworks such as Numpy, CuPy.

If you happen to write unsafe code in Rust where normal static checks are not available and want better UX for detecting memory issues along side using various sanitizers, checkout my new crate smartalloc which provides idiomatic Rust binding for the orig…

After almost a year from my last blog post, in this short post I’m very happy to announce that I’m writing a free online book where early chapters are available now.

This time we dive into std::pin which has a dense documentation.