InITNEXTbyPhil Dakin·Nov 17, 2023Getting Started with Great Expectations — Part 2Learn some of the more advanced capabilities of Great Expectations.
InITNEXTbyPhil Dakin·Nov 15, 2023Getting Started with Great Expectations — Part 1A consistent unsolved problem for many data organizations is poor data quality.
InITNEXTbyPhil Dakin·Nov 11, 2023Observing Data: Monte Carlo BasicsMonte Carlo is a data observability platform that enables organizations to monitor the quality of their data assets
InITNEXTbyPhil Dakin·Nov 4, 2023Automatic Data Platform OptimizationIt is critically important to introduce automated optimization mechanisms that continuously tune large data platform deployments.A response icon1A response icon1
InITNEXTbyPhil Dakin·Oct 27, 2023Accelerating Spark with GPUs: NVIDIA RAPIDS Code Walkthroughspark-rapids is an extension to Spark that enables GPU-based optimization during Spark query execution.
InITNEXTbyPhil Dakin·Oct 17, 2023Integrating Airflow with Databricks: Creating Custom OperatorsLearn how to implement custom Airflow operators via Databricks integration.
InDev GeniusbyPhil Dakin·Oct 12, 2023Accelerating Spark: Databricks Photon RuntimeThe Photon project provides a high-performance operator framework that integrates with Spark.A response icon1A response icon1
InDev GeniusbyPhil Dakin·Oct 10, 2023Managed Airflow: Running a Basic Task on AWS, GCP, and AstronomerThe steps required to get a basic Airflow task running on each platform.A response icon1A response icon1
InDev GeniusbyPhil Dakin·Sep 28, 2023Understanding dbt Python Models on SnowflakeTraditionally, dbt models are defined using SQL. But in early 2022, dbt Labs made an internal push to extend the dbt framework to support…
