[Airflow] raise AirflowSkipException

728x90

from datetime import datetime

from airflow.exceptions import AirflowSkipException
from airflow.models import DAG
from airflow.operators.dummy import DummyOperator
from airflow.operators.python import PythonOperator

with DAG(
    dag_id="mydag",
    start_date=datetime(2022, 1, 18),
    schedule_interval="@once"
) as dag:

    def task_b():
        raise AirflowSkipException

    A = DummyOperator(task_id="A")
    B = PythonOperator(task_id="B", python_callable=task_b)
    C = DummyOperator(task_id="C", trigger_rule="none_failed")

    A >> B >> C

https://stackoverflow.com/questions/67234176/how-to-skip-a-task-in-airflow-without-skipping-its-downstream-tasks

How to skip a task in airflow without skipping its downstream tasks?

 

728x90

저작자표시비영리

'공부' 카테고리의 다른 글

[docker] M1 MacOSX - no matching manifest for linux/arm64/v8 in the manifest list entries  (0)	2022.05.23
[gradle] mavenCentral(), jCenter(), mavenLocal(), gradlePluginPortal()  (0)	2022.05.23
[Airflow] raise AirflowSkipException  (0)	2022.05.23
[Sh] array contains  (0)	2022.05.23
[Spring] kafka config  (0)	2022.05.22
[logback] kafka-appender  (0)	2022.05.22