Prateek Dubey·Sep 24, 2021Apache Spark on Kubernetes — On-Premise (Ceph) and AWS (S3)In this article we will go through how Kubernetes works as a Cluster Resource Manager for deploying Apache Spark applications. Spark as a…
Prateek Dubey·Sep 21, 2021JupyterHub on Kubernetes — AWS & On-PremiseThis article is a continuation to my previous article on how I built a Data Platform — On-Premise on Kubernetes. To further explain how…A response icon2A response icon2
Prateek Dubey·Sep 20, 2021Data Platform — On-Premise on KubernetesThis article is about some of the work I have been doing in my prior and current organization around Data Infrastructures. For the past…
Prateek Dubey·Jul 9, 2020Databricks on AzureDatabricks is a Unified Data Analytics Platform created by Apache Spark Founders. It provides a PAAS on Azure (Partnered with Microsoft)…
Prateek Dubey·Jul 9, 2020Databricks on AWSDatabricks is a Unified Data Analytics Platform created by Apache Spark Founders. It provides a PAAS on AWS Cloud to solve complex Data…A response icon1A response icon1
Prateek Dubey·Jul 9, 2020My Business Intelligence to AI Infrastructure JourneyI graduated from University of Pune, India with a Bachelor of Engineering degree majoring in Computer Engineering in 2013. I wanted to…
Prateek Dubey·Jul 9, 2020Terraform Cloud Infrastructure — AWS, Azure and GCPAutomation of Cloud Infrastructure is a norm that every company follows. Whenever we think of Cloud platforms, the first thing that comes…
Prateek Dubey·Jun 30, 2020Free Community Edition Databricks AccountTo setup a Databricks Account, firstly we need to Sign Up using below link
Prateek Dubey·Jun 30, 2020Databricks x Airflow IntegrationDatabricks comes with a seamless Apache Airflow integration to schedule complex Data Pipelines.
Prateek Dubey·Jun 30, 2020Secure AWS NetworkingTo design a secure Infrastructure, you must be wondering if we need help from a SRE (Site Reliability Engineer) or a DevOps Engineer who…