Irem Ertürk·Jul 26, 2024Stream Processing with Python: Part 2: Kafka Producer-Consumer with Avro Schema and Schema RegistryIn Part 2 of Stream Processing with Python series, we will deal with a more structured way of managing the messages with the help of…
Irem Ertürk·Jul 3, 2023Stream Processing with Python Part 1: The Simplest Kafka Producer-ConsumerApache Kafka is a popular, stream-processing platform that can handle real-time continuous data with ensuring high throughput and low…
Irem Ertürk·Apr 4, 2022IaC with GitHub Actions for Google Cloud PlatformLet’s start with a short introduction to IaC and GitHub Actions. IaC (Infrastructure as Code) is the practice of managing and provisioning…
Irem Ertürk·Apr 3, 2022Managing Partitions with SparkIf you ever wonder why everyone moved from Hadoop to Spark, I highly recommend understanding the differences between memory and disk-based…A response icon1A response icon1
Irem Ertürk·Apr 1, 2022Data Engineering Zoomcamp by Data Talks ClubAt the beginning of this year, I have seen a post from Alexey Grigorev (founder of Data Talks Club) on Linkedin about starting a…A response icon1A response icon1
Irem Ertürk·Feb 7, 2022Advancing Apache Airflow Workflow SchedulesBy Google's definition “Apache Airflow is a workflow management platform for data engineering pipelines.” This amazing tool lets us create…
Irem Ertürk·Aug 20, 2021How I learned AWS from Scratch and became a Certified Solutions Architect Associate?Last year I have accepted a challenge and started working as a DevOps Engineer besides my background in application development and machine…