The batch pipeline highlights the integration of OLTP and OLAP systems. It starts by extracting data from MongoDB, processing it using Spark, and loading it into S3 for further OLAP operations. Note: ...

Data isn't just oil anymore; it’s the oxygen your enterprise breathes. In 2026, the volume of data flowing through the average mid-to-large enterprise isn't just massive—it’s complex, messy, and ...

DuckDB is an embedded database, similar to SQLite, but designed for OLAP-style analytics. It is crazy fast and allows you to read and write data stored in CSV, JSON, and Parquet files directly, ...

In 2024, the elephant in the room was how generative artificial intelligence seized the conversation. In 2025, the dialog shifted to agents and the question of whether there’s an AI bubble happening ...

Another year passes. I was hoping to write more articles instead of just these end-of-the-year screeds, but I almost died in the spring semester, and it sucked up my time. Nevertheless, I will go ...

Since its launch in 2013, Databricks has relied on its ecosystem of partners, such as Fivetran, Rudderstack, and dbt, to provide tools for data preparation and loading. But now, at its annual Data + ...

dbt™ is an awesome SQL-first transformation workflow that lets teams quickly and collaboratively deploy analytics code following software engineering best practices like modularity, portability, CI/CD ...

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email. Adonis: AI revenue collection for healthcare providers Startup: Adonis Recommended by: Ben Ling, Bling ...

As data analytics professionals, we all know that ETL (Extract, Transform, Load) is a critical process for data analytics projects. When it comes to choosing the right tools for ETL, DBT (Data Build ...