Inproject44 TechBlogbyRalph Brendler·Sep 7, 2023Experiments in Kafka CompressionOur use of Kafka at Project44 has continued to expand over the past several years, to the point where a large portion of our product…A response icon1A response icon1
Inproject44 TechBlogbyRalph Brendler·Jun 6, 2023Unintended Consequences (Kafka Edition)When Auto-Create Goes Wrong
Inproject44 TechBlogbyRalph Brendler·Dec 6, 2022Moving a Busy Kafka Cluster (Part 3)In previous installments, we set up XDCR to migrate the data for a busy Kafka cluster onto entirely new infrastructure, and updated the…
Inproject44 TechBlogbyRalph Brendler·Nov 1, 2022Moving a Busy Kafka Cluster (Part 2)In our last installment, we migrated the data for a busy Kafka cluster onto entirely new infrastructure without downtime. With the cluster…
Inproject44 TechBlogbyRalph Brendler·Oct 5, 2022Moving a Busy Kafka Cluster (Part 1)At project44, we use Kafka for lots of things: logging, pipelines, event ingestion, streaming APIs, asynchronous job processing, and much…
Inproject44 TechBlogbyRalph Brendler·Aug 2, 2022Micro-Partitioning: An Alternative Circuit Breaker for KafkaOne of the first things a new engineer learns when they start at project44, is that we use Kafka. A LOT of Kafka…
Inproject44 TechBlogbyRalph Brendler·May 10, 2022Data Migration Using Kafka ConnectOne of the trickier refactorings that we commonly encounter is migrating an existing service’s underlying data store to a new database or…A response icon1A response icon1