PinnedInData Science CollectivebySiddharth Ghosh·Oct 29Data Architecture Patterns: How to Choose the Right Architecture for Your Use CaseFrom batch processing and event-driven systems to CDC, Data Mesh, Data Fabric, CQRS, and microservices — understand the problem behind each…A response icon3A response icon3
PinnedInTowards Data EngineeringbySiddharth Ghosh·Sep 6Data Platform Architecture: The Guide for Data EngineersData Lake vs Data Warehouse vs Lakehouse, Medallion Architecture, Delta Lake, Table formats, data security and governance and how to choose…A response icon3A response icon3
PinnedInData Science CollectivebySiddharth Ghosh·Aug 23Modern Data Pipelines for Data Engineers: The Interview Guide (2026 Edition)Master ETL, ELT, batch vs streaming, full vs incremental loads, CDC, orchestration, idempotency, retries, backfills, and the architectural…A response icon7A response icon7
PinnedInData Science CollectivebySiddharth Ghosh·Aug 9Data Modeling for Data Engineers: The Complete Interview Guide (2026 Edition)Master OLTP & OLAP, ETL/ELT, Incremental Loading, CDC, Medallion Architecture, Dimensional Modeling, Star & Snowflake Schemas, Slowly…A response icon3A response icon3
PinnedInTowards Data EngineeringbySiddharth Ghosh·Oct 6, 2025Only Article & A Medium Membership to Crack Apache Spark InterviewsA Curated Roadmap to Master Apache Spark for Interviews and BeyondA response icon3A response icon3
InData Science CollectivebySiddharth Ghosh·Oct 6Lambda vs Kappa Architecture: Solution to Modern Batch and Streaming Data ProcessingUnderstand batch processing, stream processing, speed and serving layers, exactly-once processing, late-arriving data, reprocessing, and…
InTowards Data EngineeringbySiddharth Ghosh·Sep 30Medallion Architecture: Bronze, Silver, Gold Explained with a Real Data Engineering ExampleUnderstand Medallion architecture through, Bronze, Silver, and Gold layers, build transformations in PySpark and SQL, and get ready for…A response icon3A response icon3
InPython in Plain EnglishbySiddharth Ghosh·Aug 15Inside the Transformer: How Encoders and Decoders TalkIn Part 1, we understood why the Transformer was invented and the intuition behind Self-Attention and Multi-Head Attention. We learned how…
InPython in Plain EnglishbySiddharth Ghosh·Aug 15Understanding — Attention Is All You NeedIf you have been learning about Large Language Models (LLMs), chances are you have come across one research paper over and over again:A response icon1A response icon1
InPython in Plain EnglishbySiddharth Ghosh·Jan 28Python Modules, Packages & Imports: How Python Finds and Build CodeIn real-world Python applications, using a single file may work initially, but as the project grows, this approach leads to messy code that…A response icon1A response icon1
