Bhushan Pagar·Aug 30Apache Spark Data Pipeline Design: 15 Trade-offs Every Data Engineer Should UnderstandHow to reason about Spark pipelines beyond simply choosing Kafka, S3, Iceberg, and SnowflakeA response icon2
InGuidewire Engineering BlogbyGuidewire Engineering Team·Aug 19Scaling Apache Iceberg: Best Practices for Reliable Table MaintenancePractical ways to manage metadata bloat and handle concurrent writes without sacrificing data lake performanceA response icon1
InGuidewire Engineering BlogbyGuidewire Engineering Team·Aug 6Scaling the Data Lakehouse: How to Solve Concurrency Challenges in Apache IcebergExplore Apache Iceberg’s architecture, commit model, and troubleshooting techniques to build reliable and scalable data lakehousesA response icon1
Vaibhav Sudrik·Jul 27Building a Supply Chain Inventory Analysis Pipeline Using AWS S3, Hadoop, Hive & Power BIEvery business depends on an efficient supply chain. Managing inventory, tracking warehouse stock, and analyzing delivery performance are…
