PinnedInDev GeniusbyTugrul Gokce·Sep 24From Code to GKE: Automating Spark Deployments with GitHub Actions and Argo CDIn today’s data world, especially when working with large volumes of data, Apache Spark is one of the key components in modern data…A response icon1A response icon1
PinnedInDev GeniusbyTugrul Gokce·Jun 3, 2023ETL Orchestration on Yelp Dataset using Glue and AWS MWAA(Airflow)Have you ever wondered how organizations seamlessly transform raw, structured or unstructured data into valuable insights that drive their…A response icon1A response icon1
InDev GeniusbyTugrul Gokce·Mar 14, 2023Stream Binance Data Ingestion in AWS (Automating the Entire Data Pipeline with Boto3)What do you think about tracking cryptocurrency trading (BTC/USD) on Binance together with Amazon Web Services ? How does it sound ?A response icon1A response icon1
InDev GeniusbyTugrul Gokce·Sep 5, 2022Redis Geospatial App with Geocoding API, Streamlit and FoliumRedis(Remote Dictionary Server) is one of the most popular NoSQL databases when it comes to fast, in-memory, cache, streaming engine.
InDev GeniusbyTugrul Gokce·Aug 16, 2022Write Your Messages Directly From Cloud Pub/Sub to BigQueryRecently Google Cloud announced the new Cloud Pub/Sub subscription option(new delivery type). In this way we are able to write stream…
Inİstanbul Data Science AcademybyTugrul Gokce·Apr 24, 2022Analyzing Youtube Stream Trend Data with Spark Streaming (End to End)In 2000, only 20% of all data in the world was digitally accessible. By 2015, this rate was 98%.In addition, the size of accessible data…
Inİstanbul Data Science AcademybyTugrul Gokce·Feb 22, 2022DataFlow with Apache Nifi(Flight & Weather API, Writing various source)Hi everyoneA response icon2A response icon2
Tugrul Gokce·Feb 8, 2022Cloud Dataproc Üzerinde PySparkML Job ÇalıştırmakHerkese merhaba.Medium da ki ilk yazımda PySpark kullanarak bir veri seti üzerinde Linear Regression ve Gradient-boosted Tree Regression…