Şule Ulaş·3d agoFrom Oracle DWH to GCP: A Migration with Dataform and the Medallion ArchitectureOur goal was to move one module of our Oracle data warehouse (DWH) to Google Cloud. Along the way, we rebuilt the ODI and Oracle Database…
Pascal Parlindungan Gultom·Oct 301. Stop Copy-Pasting SQL in Dataform: A Practical Guide to Reusable FunctionsSix reusable SQL patterns for incremental models, and how to change a shared macro without breaking production.
Abhishek Nath Tiwari·Oct 9Build an End-to-End Dataform Project: From Raw Data to Production in BigQueryOver the last 14 articles, we’ve explored different parts of Dataform.A response icon1A response icon1
Abhishek Nath Tiwari·Oct 2Dataform Performance & BigQuery Cost Optimization: 10 Ways to Build Faster PipelinesWriting SQL that works is one thing.
Abhishek Nath Tiwari·Sep 26Dataform Dependencies & DAGs Explained: How Dataform Knows What to Run FirstIf you’ve worked with Dataform, you’ve probably written this many times:
Abhishek Nath Tiwari·Sep 22Dataform Tags Explained: How to Organize and Run Only the Models You NeedAs a Dataform project grows, something interesting happens.
InTowards Data EngineeringbyEmilio Flores·Sep 21“It Compiles” Is NOT a TestYou can’t just roll back a bad deploymentA response icon1A response icon1
Abhishek Nath Tiwari·Sep 18Dataform Best Practices: 10 Things I Would Do in a Production ProjectIf you have followed this series so far, you already know the basics of Dataform:
Abhishek Nath Tiwari·Sep 15Build Your First Dataform Project from Scratch: A Practical BigQuery TutorialSo far in this Dataform series, we’ve learned the individual pieces: