PinnedViral Patel·Aug 29, 2024Determine Sql Query Cost using System TablesIn this article, I am going to share my experience of system tables. I will walk you through the journey i have gone through to find out…A response icon3A response icon3
PinnedViral Patel·Mar 2, 2024Fix data issues in existing delta tables without reloading data from source.Fixes a data issue in a Databricks Delta table by performing an update on selected columns using a specified SQL function.
PinnedViral Patel·Jan 17, 2024Apply Encryption to PII Fields of Delta TablesWhen it comes to the PII (Personally Identifiable Information) or Commercially Sensitive data, It is necessary requirement of most of the…A response icon6A response icon6
PinnedViral Patel·Jan 25, 2024Databricks Delta Table StatusIn this blog, I will walk you through quick POC I have implemented to track the status of the the Delta table using delta table history. I…A response icon4A response icon4
PinnedViral Patel·Jan 15, 2024Metadata Driven Unity Catalog PermissionsMetadata driven permission for UC Securables
Viral Patel·Oct 24Stop Copying Production: Realistic Fake Data for Databricks, Straight from VS CodeHow I generate millions of related, reproducible rows in plain Spark SQL, on a laptop or inside a Databricks workspace
Viral Patel·Oct 24Setting Up Dbx → Xs Workbench: From One .vsix to Spark and Unity Catalog in VS CodeFrom one file to Spark on your laptop
Viral Patel·Sep 25I built a Databricks workspace explorer that lives inside VS CodeIt has twenty-one views, an assistant that can’t change anything without asking you first, and a strict rule that the extension never calls…
Viral Patel·Aug 16Setting up Databricks in Azure Pipelines: six errors, none of them trueI spent an afternoon connecting Azure Pipelines to Databricks without a personal access token. Every step was documented. I still failed…
Viral Patel·Aug 7We Deleted the Deployment TokenPasswordless Databricks deploys from Azure DevOps — and the seven things that bit us on the way