sdairs - the blog of Al Brown

AI agents are the new users of CLIs.

AX is the new DX.

Apache NiFi 2 added support for Python Processors, here's how to create a NiFi dev environment and install a custom Python Processor

I spent 2 long days at Kafka Summit 2024 and spoke with over 200 practitioners.

WarpStream is an interesting cloud-native Kafka alternative that is challenging the assumptions of the past.

Data Engineering is booming and many are looking for a cheat sheet to get started.

ETL provides no real value, it's just really expensive glue.

Developer Experience does not mean ‘does this look pretty’ or even ‘does this solve a problem’.

I've had a brilliant 2-and-a-bit years with Cloudera, but in a surprising turn of events, I've decided it's time for something a little bit different.

I recently took on a new role at Cloudera as a Senior Developer Advocate in the newly formed Cloudera Innocation Accelerator.

dbt has made a splash in the data ecosystem, and at the Cloudera Innovation Accelerator, we're bringing dbt to Apache Impala.

Records have become an integral part of working with NiFi.

This post is going to cover all of the basic terminology that you will need to know when working with Apache NiFi.

Pulling new files from storage is common, typically using the ListFile -> FetchFile pattern.

This post is going to walk through installing version 1.14.0 of NiFi on a Linux host (Fedora), and discuss the new secure-by-default changes.

You can easily import flow definition json files straight from the NiFi GUI.

In a previous post I discussed using REST APIs to enrich records.

It's common to want to enrich IoT data with the results of a REST API call .

Version Control is everyone's favourite subject, so how does it work with NiFi?

It's always a bit of a learning curve to get started with any new tool.

This post will quickly discuss how to configure Kafka with multiple listeners for client & inter-broker traffic.

A quick look at how to safely move the existing data directory of MariaDB on a CentOS7 host from the terminal.

In this post, I'll demonstrate one way to connect NiFi to a secured Impala with ExecuteSQL via the JDBC driver.