Hi, I am Shahzeb Ali.
I am an Data Engineer from Lahore, Pakistan. I studied Data Science at PUCIT, and most of my work is around data pipelines, SQL, dbt, Apache Spark and Delta Lake.
I also contribute to open source projects that I use in my work, including delta-rs, Kedro and Polars. So far, 12 of my pull requests have been merged. I learned more from code reviews on those PRs than from most tutorials.
I am also working on research around data quality and Change Data Capture on Delta Lake.
Here on Medium, I will write what I learn from my job, open source and research, in simple words. No theory only posts, mostly things I have actually tried, broken and fixed.
You can also find me on GitHub as Shahzeb-DataEngineer.
