Creează un cont pentru a te abona la acest blog și a-i urmări articolele pe pagina Lectură.
-
Summary The G4-FlashTree stack — Gemma 4 31B as the target, a DFlash block drafter, and a DDTree tree verifier — is the kind of system where formal methods earn their keep, because the failure modes (ghost reads after rollback, cross-path leakage in tree…
-
Code for this post is at github.com/atveit/InferenceAcceleration/tree/main/pld-gemma4-mlx.
-
Note: This work builds on the 2026 discovery by Dr.
-
mojo-tokenizer decodes tokens at 144M tokens/sec on Apple Silicon — 3.1x faster than tiktoken and 1.2x faster than rs-bpe.
-
mojo-vec brings Rust-style zero-copy buffer performance to Mojo — inline storage, pointer-based slicing, and SIMD operations.
-
mojo-json parses JSON at 6.5 GB/s on Apple Silicon — 52% faster than the fastest C++ and Rust parsers.
-
Mojo has speed.
-
A few months ago OpenAI published their open weights model(s) GPT-OSS (20B and 120B), and one of the eye-catching characteristics was that it was heavily quantized - in other words "shrunk" or compressed - to 4 bits per parameter (MXFP4) instead of the co…
-
Can an Apple Watch run a (small) LLM (SLM)?
-
https://github.com/atveit/torch_grokking https://github.com/atveit/jax_grokking What is Grokking in Deep Learning?