PinnedInData Engineer ThingsbyDilorom Abdullah·Nov 10Databricks Partner Champions Are Grown, Not HiredIn January 2026, Lumenalta had two Databricks MVPs and no panel-validated Partner Champions. Today we have 13, and 9 of them were grown…
PinnedInData Engineer ThingsbyDilorom Abdullah·Jun 24, 2025From S3 to Schema: Deploying Unity Catalog with Terraform on DatabricksIn this post, I’ll walk you through the process of creating a new catalog in Databricks Unity Catalog, using Databricks on AWS with…
PinnedInDataDarvishbyDilorom Abdullah·Mar 28, 2025Databricks Cost Optimization: Practical Tips for Performance and SavingsIn a recent Databricks cost optimization project I led, I achieved significant results: reducing unnecessary compute spend, improving…A response icon2A response icon2
PinnedInDataDarvishbyDilorom Abdullah·Mar 5, 2025Unit Testing in Data Engineering: Python, PySpark, and GitHub CI WorkflowLearn how to implement unit tests for Python and PySpark, automate testing with CI, and boost data pipeline reliability.A response icon5A response icon5
InData Engineer ThingsbyDilorom Abdullah·Aug 6The Hive Metastore Era Is Ending. Close It on Your Terms.Unity Catalog-only workspaces are becoming the platform default. Treat the cutover as a security decision you own, not a deadline you…A response icon2A response icon2
InData Engineer ThingsbyDilorom Abdullah·Sep 4, 2025Sigma + Databricks: Setup, Authentication, and Writeback ExplainedBringing Sigma and Databricks together empowers organizations to unlock governed, self-service analytics at scale. Business users get the…
InData Engineer ThingsbyDilorom Abdullah·Aug 3, 2025Building a Data App in Databricks: Automating Invoice Retrieval and PDF DeliveryIn this post, I’ll walk you through how to build a simple data app using Databricks Apps. The goal of the app is to automate the manual…A response icon1A response icon1
InData Engineer ThingsbyDilorom Abdullah·Jul 31, 2025Setting Up a Google Cloud Service Account with JSON Key for AuthenticationLearn how to create a Google Cloud service account, generate a secure JSON key, and manage access permissions for authentication in…
InData Engineer ThingsbyDilorom Abdullah·Jul 9, 2025Shhh… Secrets in Databricks: A Hands-On CLI GuideThe Databricks CLI is a powerful tool that lets you manage your Databricks workspace directly from the command line.
InData Engineer ThingsbyDilorom Abdullah·Jun 23, 2025Step-by-Step Guide to Creating a Catalog in Databricks Unity Catalog on AWSIn this post, I’ll walk you through the process of creating a new catalog in Databricks Unity Catalog, using the Databricks on AWS UI as an…A response icon2A response icon2