PinnedSiddharth Sharma·Oct 28, 2022Avoid Observability MELTdown using Metrics, Events, Logs and TracesAt the end of August 2022, I was honoured to represent Habu and attend and talk at the inaugural super{summit} developer conference in…
Siddharth Sharma·Mar 6, 2019Event-driven serverless ETL using AWS Lambda, Step Functions, EMR and FargateIn this crisp article, I will show you how to design an end-to-end serverless ETL application that is event-driven and orchestrated using…
Siddharth Sharma·Jan 8, 2019Click Stream Processing on Apache Flink using Kafka Source and AWS S3 SinkKafka-Flink-S3 : How-to-guideA response icon2A response icon2
Siddharth Sharma·Dec 18, 2018Distributed Batch Processing using Apache Flink on AWS EMR YARN ClusterBatch processing using Apache Flink on AWS EMRA response icon1A response icon1
Siddharth Sharma·Nov 17, 2018AWS EMR Log Aggregation and Visualization using Lambda, Elasticsearch, and KibanaTo me, error analysis is the sweet spot for improvement.A response icon1A response icon1
Siddharth Sharma·Nov 6, 2018Part 2: Event-driven serverless monitoring and interactive Slack alertingHow we implemented monitoring and interactive Slack alerting using Lambda, API Gateway and few other AWS servicesA response icon1A response icon1
Siddharth Sharma·Nov 1, 2018Part 1: Event-driven serverless architecture for supporting EMR Spot Instance Fleet in DataPipelineThis post describes the problem statement, implementation, and the learnings of how we solved an AWS limitation using AWS services.