Rahmadiyan·Sep 9, 2025Inside Apache Spark: Architecture, Optimizations, and Real-World WorkflowsA fresh look at how Spark tackles large-scale data, why its execution plan matters, and when it makes sense to reach for alternatives.
Rahmadiyan·Sep 9, 2025Understanding OpenMetadata: A Practical Overviewa look at how this open-source metadata platform unifies discovery, governance, and collaboration.
InData Engineering IndonesiabyRahmadiyan·Sep 15, 2024Weekly Spotify Wrapped: A Real Time Spotify Music Listening Data Streaming with PySpark, Kafka…Deep dive into how we can leverage kafka, spark streaming to process data in real-time and generate AI insight from it.
Rahmadiyan·Oct 23, 2023Building an E-commerce Data Pipeline with Airflow, Google Cloud, Twilio and MySQL
Rahmadiyan·Aug 25, 2023Automating Real-time Entry Notifications from Google Sheets using Python and Twilio
Rahmadiyan·Jul 7, 2023Optimizing Data Warehousing Strategies for Enhanced Business IntelligenceUnlocking the Power of Data: Optimize Your Data Warehousing Strategies for Enhanced Business Intelligence
Rahmadiyan·Jul 6, 2023Enhancing Data Engineering Pipelines with Data Quality ChecksEnsuring Reliable Insights: Implementing Data Quality Checks for Enhanced Data Engineering Pipelines
Rahmadiyan·Jul 1, 2023Harnessing the Power of Faker Python Library: Empowering Data Analysis with Synthetic DataUnlocking Data Analysis Potential with Faker Python Library: Generate Realistic Synthetic Data for Swift Insights & Secure Analy
Rahmadiyan·Jun 27, 2023Streamlining Data Processing with Python: Automating Data Filtering and UploadingStreamline your data processing tasks with Python and automate the filtering and uploading process.
Rahmadiyan·Jun 25, 2023Revolutionizing Payroll Management with Python: Calculating Salaries Made Easy ( A Basic Python…UBSI Basic Coding Final Project (1st semester)