Anurag Pattnaik·Sep 3Mastering Apache Spark Architecture — Journey from Drivers to ExecutorsApache Spark is a distributed data-processing framework designed to process large datasets across multiple machines. It distributes the…
InTowards AIbychakshu_salgotra·Aug 19Part IX - The Anatomy of a Spark Application — What the Driver, Executors, and Cluster Manager…Why “add more executors” fixed nothing: a component-by-component breakdown of the Spark runtime, and the failure mode each component owns
Rishabh Singh·Apr 6The City of Kubernetes: A Story of Names, Addresses, and BadgesPicture an industrial city. It has districts, a factory districts, a warehouse district, a financial districts. Each districts is…
Abhinav J Arkala·Sep 7, 2025From Spark-Submit to Success: The Secret Life of a Spark JobEver executed spark-submit and wondered what happens next? Once you hit Enter, and after a few moments, a distributed computing job springs…
InTowards DevbyGetSetMuv·Dec 6, 2023Steps to setup and run Spark App in DockerDocker is a crucial tool for setting up any application seamlessly, eliminating concerns about dependencies in your local environment. It…
