PinnedTom Kaszuba·Dec 25, 2020Avro Schema Evolution Strategies on KafkaIf you have spent any significant time with Avro (or Protbuf) and are using the Confluent Schema Registry you probably have encountered a…
PinnedInThe StartupbyTom Kaszuba·Oct 2, 2020ETL Batch Processing With Kafka?Kafka is most likely not the first platform you reach for when thinking of processing batched data. Most likely you’ve heard of Kafka…A response icon3A response icon3
PinnedTom Kaszuba·Jan 23, 2024Hard vs Soft deletes in KafkaThere are several ways on how to model a delete event in Kafka with each having their own advantages and disadvantages. While using…
PinnedTom Kaszuba·Feb 13, 2024Synchronize two lookup topics using foreign key joins in Kafka StreamsPart 1: The theory
Tom Kaszuba·May 2, 2024How to purge Kafka Streams DSL state storesIntroductionA response icon1A response icon1
Tom Kaszuba·Apr 29, 2024Thanks for this article.For me Kafka is a natural choice as the source of truth for a data lake but there are still many people that perceive this as an…
Tom Kaszuba·Feb 21, 2024Historized SCD lookups with Versioned Stores and IQv2 in Kafka StreamsIntroduction
Tom Kaszuba·Dec 25, 2022The curious case of missing headers in Kafka StreamsKIP-82 Introduced headers to Kafka and they’ve been a hit ever since. Headers allow you to pass metadata information such as logging…A response icon1A response icon1
Tom Kaszuba·Nov 7, 2022How to sink a Kafka roll outHas management started to flirt with the idea of doing event sourcing and rolling out a Kafka cluster? Have you read up on the technology…