PinnedInData Engineer ThingsbyAlex VolokยทJul 13Python Data Engineering: 10 Steps From a Slow Team to a Delivering OnePre-commit hooks, trunk-based development, ephemeral environments, and other practices the team fully controlsA response icon2A response icon2
PinnedAlex VolokยทJul 10Unit Testing PySpark Without the FrictionHow a small pytest plugin removes the boilerplate of Spark sessions, Delta Lake JARs, and test datasets
PinnedInPlumbers Of Data SciencebyAlex VolokยทJul 30, 20235 Approaches to ad hoc Dataframes in PySparkVarious ways to create small Spark dataframes in place without external dependenciesA response icon1A response icon1
PinnedInPlumbers Of Data SciencebyAlex VolokยทJun 12, 2023Scripting PySpark DataframesReproducing and transporting dataframes by generating plain Python scripts
PinnedInBetter ProgrammingbyAlex VolokยทApr 26, 2023Delta-RS and DuckDB โ Read and Write Delta Without SparkAn alternative toolset to Spark for low-latency operations with small to medium-size datasetsA response icon2A response icon2
InPlumbers Of Data SciencebyAlex VolokยทMay 26, 2023Delta Properties and Check Constraints at ScaleManaging Delta Table Properties and Check Constraints using PythonA response icon1A response icon1
InPlumbers Of Data SciencebyAlex VolokยทMay 12, 2023Towards Databricks Certified Data Engineer ProfessionalA compilation of observations and tips to achieve this credentialA response icon1A response icon1
Alex VolokยทApr 16, 2023Databricks Observability: Processing Collected Ganglia MetricsDatabricks Observability SeriesA response icon2A response icon2
Alex VolokยทApr 4, 2023Databricks Observability: Collecting Ganglia MetricsDatabricks Observability SeriesA response icon2A response icon2