Skip to content

astronomer/airflow-3-demos

 
 

Repository files navigation

Webinar demo

This repository contains the demo code for the Introducing Apache Airflow® 3.0 webinar.

Personalized Newsletter pipeline

Personalized newsletter pipeline architecture diagram

This pipelines hows:

  • @asset syntax
  • data-aware scheduling
  • event-driven scheduling and inference execution
  • dynamic task mapping

Syntax examples

The dags/syntax_examples folder contains simple dags showing Airflow 3.0 features.

How to run this demo

  1. Fork and clone this repository.
  2. Make sure you have the Astro CLI installed and are at least on version 1.34.0. You can upgrade with brew upgrade astro.
  3. To run the full demo DAGs you will need an OpenAI API key, copy the .env_example file to .env and add your OpenAI API key to the file. For the syntax examples you don't need any API keys or connections.
  4. Run astro dev start to start the local Airflow instance.
  5. Enjoy Airflow 3.0!

You can learn more about the new features in our Learn guides:

To learn how to upgrade from Airflow 2 to Airflow 3, check out the upgrade guide. Check out the release notes for a full list of new features improvements and changes.

About

Airflow 3 demos from DevRel

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published