Luis Lema·Oct 8Spinning up the Apache Spark History Server on WindowsThe History Server Web UI bundled with your local Apache Spark installation on Windows is not ready to use out of the box, but it’s easy to…
Jayasurya Pilli·Aug 27Spark UI Essentials: 2. Spark UI Guided TourSpark UI has a lot of tabs. But when you’re investigating Spark SQL query performance, do you really need to understand every one of them?
The Data Forge·Aug 24Practice Exam 3: CI/CD with DABs, Troubleshooting, and Security and GovernanceDataForge Series: Databricks Data Engineer Associate - Part 16 of 16
The Data Forge·Aug 12Troubleshooting Databricks: Spark UI, OOM, and the Diagnostic Workflow That Actually WorksDataForge Series: Databricks Data Engineer Associate - Part 11 of 16
Srushti Gadera Manjunathappa·Aug 5Working with Spark DataFrames: The Operations Every Beginner Should KnowIn the last post, we learned what a DataFrame actually is, and why Spark treats every column as an expression instead of raw data. Every…A response icon2A response icon2
keisuke nebashi·Jul 30Viewing the Spark UI with the AWS Glue Docker ImageWhen running PySpark scripts locally using the AWS Glue Docker image, you can use the Spark History Server to inspect job execution…
InTowards Data EngineeringbyÁngel Álvarez Pascua·Jul 7✨Spark UI Trek: The Klingon AttackSpark UI: The Last Frontier. A chaotic telemetry matrix where cheerful progress bars pretend everything is fine, while red error logs…
Ilekura Idowu·Dec 9, 2025Supercharging Spark Monitoring: Dataflint on Databricks with TerraformIntroduction