Mihirsaurkar·Nov 15, 2024Taking Glue To Next Level: Cross-Account, Cross-Region Data Pipelines with dbt-Glue and Apache…In real-world scenarios, data pipelines seldom operate within the confines of a single AWS account or region. Modern data lakes scale and…
Mihirsaurkar·Jan 29, 2024ELT Using Glue DBTI came across the AWS big data blog that advocates using S3 as data store and manage transformations using GLUE spark interactive session…A response icon1A response icon1
Mihirsaurkar·Jun 5, 2023Migration of a Workload running in a Corporate Data Center to AWS using the Amazon EC2 and RDS…In another project based in a real-world scenario, I acted as the Cloud Specialist responsible for migrating a workload running in a…
Mihirsaurkar·May 25, 2023From Theory to Practice: Implementing Multi-class Classification with KNN SKLearnI recently came across a very common problem in managing data which is normalization. Most analysts would prefer to go about it on excel by…
Mihirsaurkar·May 8, 2023Automated user migration and management of AWS Identity and Access Management (IAM) resourcesIntroduction