PinnedInData Engineer ThingsbyLorena Gongang·Apr 16, 2025How to Set Up CI/CD with Databricks Asset Bundles and GitHub ActionsFrom VS Code to Databricks — a step-by-step CI/CD workflow with GitHub Actions and Asset Bundles.A response icon2A response icon2
PinnedInData Engineer ThingsbyLorena Gongang·Apr 29, 2025Data Quality Checks with Databricks DQX: A Step-by-Step GuideAutomate data quality checks, detect errors, and optimize your data pipeline using Databricks DQX Framework.A response icon3A response icon3
PinnedInData Engineer ThingsbyLorena Gongang·Jun 1, 2025Data Quality With Airflow SQL Check Operators: A Step-by-Step GuideAutomate data quality checks, detect errors, and stop bad data downstream using Airflow’s SQL Check OperatorsA response icon2A response icon2
InData Engineer ThingsbyLorena Gongang·Dec 1, 2025How I built Data Quality Alert System with GX, Slack and CI/CDA step-by-step guide to automating data quality checks with GX and sending real-time alerts to Slack within a CI/CD workflowA response icon1A response icon1
InData Engineer ThingsbyLorena Gongang·Nov 18, 2025How I integrate Great Expectations into CI/CDTest Data Quality during CI/CD development.A response icon1A response icon1
InData Engineer ThingsbyLorena Gongang·Nov 8, 2025How I Validate Data Schema with GreatExpectations (GX): A Step-by-Step GuideAutomate schema validation, detect structural issues early, and keep your data pipelines consistent with Great Expectations (GX).A response icon2A response icon2
InData Engineer ThingsbyLorena Gongang·Sep 30, 2025How I Validate Data Freshness with GreatExpectations (GX): A Step-by-Step GuideAutomate data freshness checks, catch stale or outdated data, and ensure reliable pipelines with Great Expectations (GX).A response icon1A response icon1
InData Engineer ThingsbyLorena Gongang·Aug 27, 2025Data Pipeline Alerting With Airflow 3.0 Notifiers and Slack: A Step-by-Step GuideAutomate pipeline monitoring, catch failures early, and stay informed with Slack alerts from Airflow 3.0.A response icon2A response icon2
InData Engineer ThingsbyLorena Gongang·Jun 18, 2025Data Quality with Airflow Circuit Breakers: A Step-by-Step GuideDetect and prevent bad data from causing downstream failures using Airflow’s ShortCircuitOperator.A response icon1A response icon1
InData Engineer ThingsbyLorena Gongang·May 18, 2025How To Implement Column Masking in Databricks To Protect Sensitive DataGive Data Analysts the Data They Need — Without Exposing What They Shouldn’t SeeA response icon1A response icon1
