Data Engineering

Data Lake

Explore recommended reads, summarized by AI

Architecture and Design

Explorations of how to structure and organize data storage systems and platforms.

Data Architecture Evolution

Table Formats

Technical guides and analyses of open table formats for managing data at scale.

Apache Iceberg

Delta Lake

Popular this week

In

Level Up Coding

by

Thomas Reid

Building a data lakehouse with DuckDB and DuckLake

In

Towards AWS

by

Gianfranco Arena

Aurora PostgreSQL now has DuckDB inside. I tested it on 59 million rows

balaji bal

Scaling Customer Segmentation in Banking with HyperLogLog

Divyansh Goyal

Stop Building Custom Pipelines: A Metadata-Driven File Ingestion Framework

In

Data Engineer Things

by

Santosh Shinde

Stop Reading About Lakehouses- Build One Locally

Latest stories

Fizamohammadd

Data Warehouse vs. Data Lake vs. Lakehouse: Understanding Data Storage in Databricks

In

Towards Data Engineering

by

Shree Kavya

What’s New in Data Engineering, Part 4: Spark’s CHANGES Clause, Delta 4.4

Data Do GmbH

Serverless Analytics & Vector Search on Kubernetes: Building a Lean Data Warehouse with DuckDB…

Jasoniel Santana

Building a Modern Data Lake with Databricks and Apache Spark: Lessons from Insurance and Telecom

Tanujamane

Where Should an Online Store Keep Its Data? Warehouse vs Lake vs Lakehouse

See more stories

Who to follow

Popular this week

In

Level Up Coding

by

Thomas Reid

Building a data lakehouse with DuckDB and DuckLake

In

Towards AWS

by

Gianfranco Arena

Aurora PostgreSQL now has DuckDB inside. I tested it on 59 million rows

balaji bal

Scaling Customer Segmentation in Banking with HyperLogLog

Divyansh Goyal

Stop Building Custom Pipelines: A Metadata-Driven File Ingestion Framework

In

Data Engineer Things

by

Santosh Shinde

Stop Reading About Lakehouses- Build One Locally

Latest stories

Fizamohammadd

Data Warehouse vs. Data Lake vs. Lakehouse: Understanding Data Storage in Databricks

In

Towards Data Engineering

by

Shree Kavya

What’s New in Data Engineering, Part 4: Spark’s CHANGES Clause, Delta 4.4

Data Do GmbH

Serverless Analytics & Vector Search on Kubernetes: Building a Lean Data Warehouse with DuckDB…

Jasoniel Santana

Building a Modern Data Lake with Databricks and Apache Spark: Lessons from Insurance and Telecom

Tanujamane

Where Should an Online Store Keep Its Data? Warehouse vs Lake vs Lakehouse

See more stories

Who to follow