Ganesh Chandrasekaran·Oct 27Hierarchical Clustering in DatabricksChoosing clustering columns starts with understanding how the table is queried. In this experiment, I compared three liquid clustering…
Ganesh Chandrasekaran·Oct 23Genie Code: What I Use Daily and What I Still Double-CheckOf all the products in the Genie family, Genie Code is the one I use the most on a daily basis.
Ganesh Chandrasekaran·Oct 20Query Unity Catalog Views and Delta Tables from External Apache SparkLearn how to query Unity Catalog views from external Apache Spark using the Unity REST API and Iceberg REST catalog, with step-by-step…
Ganesh Chandrasekaran·Oct 6Still Hesitant About Lakeflow Declarative Pipelines? Let’s Clear Up a Few Things.Lakeflow Declarative Pipelines has evolved significantly. Older DLT articles can describe behavior that no longer applies to current…
Ganesh Chandrasekaran·Jul 3Meet the Databricks GeniesIf you’ve been wondering what each Genie does, this quick cheat sheet gives you a one-line overview of every member of the Databricks…
Ganesh Chandrasekaran·Jul 3Databricks: Genie One vs Genie SpacesWhat’s the difference between Genie One and Genie Spaces? Aren’t they the same thing? They are related, but not the same.
InDataDrivenInvestorbyGanesh Chandrasekaran·Mar 20Copy Teradata Data to Databricks UC using Foreign CatalogWhen migrating workloads from Teradata to Databricks, the most common approach for large datasets is using Teradata Parallel Transporter…
InDataDrivenInvestorbyGanesh Chandrasekaran·Mar 3Lakebase: Removing the App to Lakehouse frictionIn almost every organization, the data flow looks the same.A response icon1A response icon1
InDataDrivenInvestorbyGanesh Chandrasekaran·Mar 3Governance by Design with Databricks Asset BundlesWhen you use Databricks Asset Bundles as the source of truth for deploying Jobs, Pipelines, and Dashboards, permissions are no longer an…
Ganesh Chandrasekaran·Dec 9, 2025Databricks: Native Excel Support in SparkRecent Spark releases finally let you read .xls and .xlsx files natively. No third-party drivers, no hacky workarounds. This example uses…