Rathboma's blog

Claude redesigned a bunch of our webpages and app screens. 3 months later I'm undoing it all

Our new NPM package maintains Vue.js 2.7 build capabilities for Vite 8+, thanks to the Vue2 community

Parquet provides significant benefits for sparse reads of large datasets, but is it always the file format to use?

File formats can be confusing, so lets delve into Columnar file formats (like Parquet) and explain why they're different to regular formats (like CSV, JSON, or Avro)

I'll talk through the basics of Threads, Akka, Futures, and Timers in this quick overview of concurrency for Scala.

Scala's apply functions are commonly seen alongside case classes, but they can do so much more.

While Scala is amazing it has an overwhelming number of features.

Apache Spark is a powerful technology with some fantastic books.

I'll walk through what we mean when we talk about 'storage formats' or 'file formats' for Hadoop and give you some initial advice on what format to use and how.

Confused about whether Map Reduce is one word or two?

Scalding's scala-like API lets us join and summarize data quickly and easily, but beware -- it looks like regular scala, but sometimes behaves differently.

Joining and analysing data in Hadoop using Python MapReduce.

Software engineers from Cloudera, Foursquare, Spredfast, JauntVR, and Elondina chat with me about their favorite Hadoop MapReduce frameworks and why they like them.

To follow my post implementing a pipeline in regular Spark, I do the same thing with Java.

I implement a realistic pipeline in Spark as part of my series on Hadoop frameworks.

Apache Hive differs significantly from traditional relational databases like MySQL.

How to implement some real world code with Scalding, a Scala wrapper for Cascading

How to implement all sorts of custom functions for hive, including complex functions like 'sum()', 'count()', and 'explode()'

How to use Java & Cascading to perform a left outer join.

A rundown of the common query engines for Hadoop, with some of their pros/cons

A survey on data warehousing and Hadoop Deployments.

How to read files from hdfs using Java and Scala, even if they are compressed, using any FileSystem implementation.

A step-by-step tutorial for writing your first map reduce with Python and Hadoop Streaming.

How to use Scala & Scoobi to perform a left outer join.

a walk-through (with code) of writing user defined functions (UDFs) for Apache Hive.

A compilation of books for Hadoop and related projects (hive, pig, hbase, etc).

What is Hadoop - A high level overview of Hadoop without going in to too much technical detail.

How to use Pig to perform a left outer join.

blog post by Matthew Rathbone

How to use hive to perform a left outer join.

An exciting feature of sublime text 2 I never knew about.

A constantly expanding list of 12+ hadoop frameworks, with code examples and documentation links

step-by-step guide to formatting references in APA, with screenshots.

A useful Sublime Text 2 plugin for scala users

a walkthrough and code for building games with scala using libgdx and box2d.

A hidden feature of sublime text 2 that you can't possibly live without.

a step-by-step walkthrough for adding custom page number layouts to Microsoft Word using section breaks and a lot of clicking

an alternative setup for deploying jars to hive.