Skip to content

New example along storyline: Planned maintenance #52479

Open
@jscheffl

Description

@jscheffl

Description

As described in https://cwiki.apache.org/confluence/display/AIRFLOW/Examples+Refurbish

A new Dag is implemented along the described storyline for "Maintenance"

This includes:

  • New Dag is added in Taskflow as well as classic implementation
  • Dag is according to checklist
  • Previous examples that are content-wise replaced are deleted to incrementally clean-up
  • Airflow documentation is adjusted to point to new examples are replaced
  • General example storyline overview is adjusted and the functioning of the new example is described

Use case/motivation

Airflow Examples have been grown in number and focus over the past years. They purpose multiple things:

Serve as tutorials to learn Airflow DAG implementation
Serve with code snippets for documentation
Serve for testing the setup
(some) service for CI integration testing

Some example DAGs are in a good quality, some are not following best practices. Current examples do not follow a structure.

There are example DAGs contained in the Airflow core (currently pushed to standard provider/example_dags) as well as there are more examples in other providers. But examples from other providers are lot loaded automatically.

So in the Airflow 3 Dev Calls there was a demand named to clean-up and optimize example DAGs.

Related issues

#52476 is made before and might be adjusted

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions