Small Data And self service

This post, the repo and every number in it are personal opinion.

This rabbit hole started with a simple observation: VertiPaq seemed to like parquet produced by delta-rs more than parquet produced by DuckDB — and that drove me nuts. delta-rs was at the time a niche library for nerds; Fabric didn’t even have a Python no…

Edit : I vibe coded one, so you dont need to read this whole text https://djouallah.github.io/fabric-context-layer As a data analyst, I have been following the progress of LLMs in analytics, and although there has been some progress in accuracy and in the…

I have been using AI in VS Code and Onelake, initially trying to make sense of Chat with your data (without much success, that thing is very hard and we need some breakthrough), and more recently for data engineering.

duckrun is a package I built using AI exclusively, to solve pain points I hit when using Fabric Python notebooks.

1. delta-rs is an ACID Delta writer delta-rs implements the Delta Lake protocol natively. merge, update, and delete go through optimistic concurrency control on every commit.

Four years ago I wrote a blog about using DuckDB with Power BI in DirectQuery.

DuckLake supports multi-writer just fine — but only if your catalog is a real database, like Postgres (there’s some interest in SQL Server support too).

TL;DR: Iceberg’s value is sociological, not technical.

Microsoft Fabric lets you dynamically configure the number of vCores for a Python notebook session at runtime — but only when the notebook is triggered from a pipeline.