InternetException

I posted already about me selfhosting LLM models.

I know that LLM or Large Language Models are designed to mimic what people write, but still from time to time it surprises me and make me chuckle.

Qwen 3.8 is out since Friday, 17 of August.

Just couple of days ago poolside released their new model: Laguna S 2.1.

I bought new phone and I started installing applications from previous device.

I remember when I started selfhosting my own instance of GitLab, which had simple code editor that allows you to edit code quickly inline.

I do not know… I find it funny.

Just out of curiosity I tested Qwen3.6-27B model with MTP speculative decoding with 6 draft tokens.

After optimizing lately my vllm startup I started optimizing performance of vLLM during inference.

AI hype is calming down in some companies, but in others like in the one I am currently consulting for, we still on the hype.