Rakesh Erazuth Mohandas·Nov 12, 2025Unlocking Efficiency: Optimizing BigQuery Pipelines in Cloud Composer with Deferrable OperatorsAs a Solution Architect working with Big Data Analytics on Google Cloud, I frequently see a specific anti-pattern emerge as data teams…
Rakesh Erazuth Mohandas·Jul 22, 2025Dataproc Zero-Scale Down Cluster Creation ProcessDataproc Zero-Scale clusters offer a cost-effective solution for running Spark, Hadoop, and other Big Data workloads on Google Cloud…
Rakesh Erazuth Mohandas·Jun 8, 2025Building an AI-Powered Catalog Enrichment using Gemini for BigqueryThis document provides a comprehensive overview of the AI-Powered Catalog Enrichment tool, a Streamlit application designed to…
Rakesh Erazuth Mohandas·Apr 20, 2025Kill Switch for Spark: Auto-Detect and Terminate Stuck Jobs Across All ApplicationsOverview
Rakesh Erazuth Mohandas·Apr 12, 2025Automatic Termination of Long-Running Interactive Spark Jobs in DataprocOverview
Rakesh Erazuth Mohandas·Apr 2, 2025Effortless Integration: Connecting Cursor to Dataproc for Interactive Spark DevelopmentWhat’s Cursor?
Rakesh Erazuth Mohandas·Mar 22, 2025Connecting VS Code to Google Cloud Dataproc for Interactive PySpark DevelopmentThis guide provides step-by-step instructions on how to connect Visual Studio Code (VS Code) to Google Cloud Dataproc for interactive Spark…
Rakesh Erazuth Mohandas·Mar 17, 2025BigQuery Data Masking and Fine-Grained Access Control: Best Practices for Secure Data AccessIntroduction
Rakesh Erazuth Mohandas·Mar 5, 2025Running Multiple Spark SQL Jobs in a Shared Spark Session in Google DataprocOverview