PinnedInDatabricks Community ArticlesbyVikneshwara Balakrishnan·Sep 16What Spark Declarative Pipelines Actually Solves — Built with F1 API Race DataPrerequisites (optional, but helpful)
PinnedVikneshwara Balakrishnan·Aug 17, 2025Modern Data Stack in Action: Practical guide to build data pipelines with DBT Projects feature on…Disclaimer
InSnowflake Builders Blog: Data Engineers, App Developers, AI, & Data SciencebyVikneshwara Balakrishnan·Nov 6Query Databricks Lakeflow Pipeline Tables from Snowflake, Without Copying DataStreaming tables and materialized views, read in place as Iceberg: the settings that matter, what the logs show, and the Snowflake errors I…
Vikneshwara Balakrishnan·May 16Building an Incremental ELT Pipeline with Databricks Lakehouse FederationThis is a walkthrough of an ELT pipeline I built that reads from an Azure SQL database, loads data incrementally into Databricks through…A response icon1A response icon1
Vikneshwara Balakrishnan·May 3Building a Production-Ready Data Pipeline on Azure — The Music Streaming Platform PlaybookA beginner-to-intermediate walkthrough of how data flows from a raw database all the way to a clean, historical data warehouse — using…A response icon1A response icon1
InSnowflake Builders Blog: Data Engineers, App Developers, AI, & Data SciencebyVikneshwara Balakrishnan·Dec 5, 2025Automate Your DBT Pipelines Using DBT Projects Feature: CI/CD and Dynamic Orchestration on…TL;DR: Transform manual DBT task management into automated, production-ready pipelines using JSON-driven orchestration and GitHub Actions…A response icon1A response icon1
InTowards AWSbyVikneshwara Balakrishnan·Dec 3, 2025AWS Data Engineering Made Simple: Orchestrating DBT with Managed AirflowThe Challenge That Every Data Engineer Faces
Vikneshwara Balakrishnan·Nov 4, 2025From Scheduled Chaos to Intelligent Automation: Building Self-Managing Data Pipelines with…Part 2 of a 2-Part Technical Implementation Series
Vikneshwara Balakrishnan·Nov 3, 2025Automated Data Pipeline Design: A Deep Dive into Snowflake Dynamic Tables StrategyPart 1 of a 2-Part Technical Implementation SeriesA response icon1A response icon1
Vikneshwara Balakrishnan·Aug 17, 2025Modern Data Stack for Analytics: Medallion architecture, DBT, the ELT Revolution and SnowflakeIntroduction