PinnedInTDS Archivebyraphaelauv·Feb 13, 2022Apache Airflow : 10 rules to make it work ( scale )Airflow is by default very permissive and without very strict rules it will fail to scale.A response icon9A response icon9
raphaelauv·Feb 12, 2022It’s time to do infra as REAL codeIt’s time to use programming languages(python , go , java , typescript …) and no more declarative configuration languages ( HCL , YAML …A response icon1A response icon1
raphaelauv·Sep 22, 2020Scale vertically Kafka consumersLow footprint multi-threaded Kafka Consumers using CompletionService.