Hamza's Blog

Introduction Modern ML workloads depend heavily on custom GPU kernels.

🚧 Work in progress.

Large Language Models (LLMs) have been a critical point in the advancement of the field of AI, arguably the greatest technological innovation in the last decade (In NLP).

Large language models (LLMs) are trained in highly parallel, compute-bound workloads, but serving them is very different: inference is memory-bound and sequential.