小编Vat*_*iya的帖子

如何通过单个脚本生成多个气流 dags?

我想使用一个脚本生成多个气流 dag。dag 名称应为“test_parameter”。下面是我的脚本:

from datetime import datetime

# Importing Airflow modules
from airflow.models import DAG
from airflow.operators import DummyOperator

# Specifying the default arguments for the DAG
default_args = {
    'owner': 'Test',
    'start_date': datetime.now()
    }

parameter_list = ["abc", "pqr", "xyz"]

for parameter in parameter_list:
    dag = DAG("test_"+parameter,
              default_args=default_args,
              schedule_interval=None)
    dag.doc_md = "This is a test dag"

    # Creating Start Dummy Operator
    start = DummyOperator(
        task_id="start",
        dag=dag)

    # Creating End Dummy Operator
    end = DummyOperator(
        task_id="end",
        dag=dag)

    # Design workflow of …
Run Code Online (Sandbox Code Playgroud)

python workflow directed-acyclic-graphs airflow

6
推荐指数
2
解决办法
5626
查看次数