我正在尝试DockerOperator
在 Mac 上使用 Airflow。我正在运行基于Puckel 的Airflow,并做了一些小的修改。
Dockerfile 构建为 puckle-airflow-with-docker-inside:
FROM puckel/docker-airflow:latest
USER root
RUN groupadd --gid 999 docker \
&& usermod -aG docker airflow
USER airflow
Run Code Online (Sandbox Code Playgroud)
docker-compose-CeleryExecutor.yml.:
FROM puckel/docker-airflow:latest
USER root
RUN groupadd --gid 999 docker \
&& usermod -aG docker airflow
USER airflow
Run Code Online (Sandbox Code Playgroud)
DAG 中的任务/操作定义:
version: '2.1'
services:
redis:
image: 'redis:5.0.5'
postgres:
image: postgres:9.6
environment:
- POSTGRES_USER=airflow
- POSTGRES_PASSWORD=airflow
- POSTGRES_DB=airflow
webserver:
image: puckel-airflow-with-docker-inside:latest
restart: always
depends_on:
- postgres
- redis
environment:
- LOAD_EX=n …
Run Code Online (Sandbox Code Playgroud)