This repository contains the demo code for the Introducing Apache Airflow® 3.0 webinar.
This pipelines hows:
@asset
syntax- data-aware scheduling
- event-driven scheduling and inference execution
- dynamic task mapping
The dags/syntax_examples
folder contains simple dags showing Airflow 3.0 features.
- Fork and clone this repository.
- Make sure you have the Astro CLI installed and are at least on version 1.34.0. You can upgrade with
brew upgrade astro
. - To run the full demo DAGs you will need an OpenAI API key, copy the .env_example file to .env and add your OpenAI API key to the file. For the syntax examples you don't need any API keys or connections.
- Run
astro dev start
to start the local Airflow instance. - Enjoy Airflow 3.0!
You can learn more about the new features in our Learn guides:
To learn how to upgrade from Airflow 2 to Airflow 3, check out the upgrade guide. Check out the release notes for a full list of new features improvements and changes.