Kidong Lee·Jun 2Meet kiok — a workflow orchestrator that ships with its own brainIf you have ever stood up a workflow scheduler in production, the shopping list is depressingly familiar:
Kidong Lee·Aug 8, 2024Run Spark SQL ETL Jobs with Azkaban in ChangoTrino ETL queries can be run through REST simply with Chango Query Exec in Chango as I mentioned in the previous article. In addition…
Kidong Lee·Jul 29, 2024Run Trino ETL Jobs with Azkaban in ChangoTrino ETL queries can be sent to Chango Query Exec through REST to run ETL query jobs in trino with ease. So Chango Query Exec is more…
InCodeXbyApache DolphinScheduler·Jun 22, 2022How does Fordeal Data Platform Scheduler migrate from Azkaban to Apache DolphinScheduler smoothly?The data platform scheduler of Fordeal was previously built on Azkaban for redevelopment, but it’s hard to use both at the user level and…
InTrendyol TechbyDoğanay Şahin·Jun 25, 2021Experimenting Azkaban as Workflow ManagerAzkaban is a workflow manager which is written and open-sourced by LinkedIn to execute Hadoop jobs at the beginning. But it is not limited…
Sunil kumar·Jan 21, 2021Apache Azkaban with PostgresqlRunning Apache Azkaban with Postgresql was a blocker for us that made us think about switching to Airflow(not planned so quick). I will…
InRapido LabsbyChethanUK·Sep 3, 2020Why is Airflow an excellent fit for Rapido?Back in 2019, when we were building our data platform, we started building the data platform with Hadoop 2.8 and Apache Hive, managing our…A response icon1A response icon1
InDataDrivenInvestorbyYaser Sakkaf·May 1, 2020Install Azkaban in UbuntuThis article walks you through the steps to install Azkaban 3.84.14 in your Ubuntu 18.04.4 LTS machine.
InEdumall EngineeringbyNguyễn Minh Đức·Jul 11, 2019Sơ lược về quá trình ETL ứng dụng trong dự án Custom Data Platform.1. Mô tả luồng logic của quá trình transform data
InThe Telegraph EngineeringbyAmir Zareian·Jan 23, 2018How to orchestrate Azkaban pipelines using the power of graphsIn The Telegraph Data Team we build ETL (Extraction, Transform, Loading) pipelines. ETL refers to a process in database usage, particularly…