Rusty Conover — rusty.today

1.

I shared how 🦆DuckDB can seamlessly work with Apache Arrow Flight to provide universal data access.

I'm going to demo of write support for #DeltaLake tables, building a machine learning prediction model with #AutoGluon in only #SQL, and wrap up with some...

DuckCon 6 in Amsterdam is just a few weeks away!

I'm excited to announce the datasketches extension for DuckDB, which integrates the capabilities of Apache DataSketches with DuckDB's aggregate and scalar...

Introducing a DuckDB extension that interprets cron expressions to generate scheduled timestamps directly in SQL, built with the Rust croner crate.

Introducing shellfs, a DuckDB extension that enables seamless integration with Unix pipes for both input and output, allowing command-line programs to be used directly within DuckDB queries.

How to build a kitchen-sink observability event stream using AWS EventBridge, Firehose, and Apache Iceberg to capture and query every event in your distributed system.

A practical guide to the essential metadata columns every data platform should store alongside its data, enabling traceability back to source files and loader versions using Apache Parquet's efficient encoding.

Why DuckDB is becoming the go-to tool for data tasks in 2024, along with key areas where improvements are still needed including Iceberg support, Parquet encodings, and remote data throughput.

An investigation about how to store a large number of referenced URLs while considering WebP and AVIF recompression for images.

Solving the problem where you have a lot of data you want to allow customers to obtain (provided they purchased access), but you don't want to pay for their internet transfer fees can be tricky.

Looking into various web chat front end implementations

Cities and airports stream their radio traffic to the internet, you can listen to police or firetrucks being dispatched or airplanes being given headings and altitudes.

A summary of thoughts about purgeable memory allocations and distributed caching.

A short adventure in prediction for electrical generation and demand in New York State.

My personal research notes into multi-dimensional indexing strategies for data, involving Z-order curves and Hilbert curves.

A fire started on the Bridger Range last Friday.

Preferred Pictures is a software-as-a-service that algorithmically determines which image from many that will result in the most sales and conversions in a way that is arguably that is better than A/B tests.

My short guide to adventures and happiness in Tulum, Mexico

Find short domain names that are able to be registered

Goal: Find the largest integer where all triples are unique and prime.

ffmpeg is a very versatile piece of software for working with video.