小编bux*_*oum的帖子

如何将气流工人的数量安装到气流 kubernetes pod 操作员?

我正在尝试在气流中使用 kubernetes pod 操作符,并且我希望在气流工作器上与 kubernetes pod 共享一个目录,有没有办法将气流工作器的目录挂载到 kubernetes pod?

我尝试了下面的代码,但卷似乎没有成功安装。

import datetime
import unittest
from unittest import TestCase
from airflow.operators.kubernetes_pod_operator import KubernetesPodOperator
from airflow.kubernetes.volume import Volume
from airflow.kubernetes.volume_mount import VolumeMount


class TestMailAlarm(TestCase):
    def setUp(self):
        self.namespace = "test-namespace"
        self.image = "ubuntu:16.04"
        self.name = "default"

        self.cluster_context = "default"

        self.dag_id = "test_dag"
        self.task_id = "root_test_dag"
        self.execution_date = datetime.datetime.now()

        self.context = {"dag_id": self.dag_id,
                        "task_id": self.task_id,
                        "execution_date": self.execution_date}

        self.cmds = ["sleep"]
        self.arguments = ["100"]

        self.volume_mount = VolumeMount('test',
                                        mount_path='/tmp',
                                        sub_path=None,
                                        read_only=False)

        volume_config = {
            'persistentVolumeClaim':
                { …
Run Code Online (Sandbox Code Playgroud)

python docker kubernetes airflow airflow-operator

5
推荐指数
1
解决办法
4629
查看次数

标签 统计

airflow ×1

airflow-operator ×1

docker ×1

kubernetes ×1

python ×1