使用 Apache Airflow 运行 Bash 命令时“不允许使用朴素的日期时间”

jav*_*dba 3 sqlalchemy airflow

sqlAlchemy自教程编写以来, 它看起来可能已经进行了改版:它不接受教程中显示的Airflow格式的日期,网址为http://pythonhosted.org/airflow/tutorial.htmlYYYY-DD-MM

 $airflow test tutorial print_date  2017-12-30
[2017-12-29 19:10:40,695] {__init__.py:45} INFO - Using executor SequentialExecutor
[2017-12-29 19:10:40,745] {models.py:194} INFO - Filling up the DagBag from /git/airflow/home/dags
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 4, in <module>
    __import__('pkg_resources').run_script('apache-airflow==1.10.0.dev0+incubating', 'airflow')
  File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 748, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  ..
   File "build/bdist.macosx-10.12-x86_64/egg/sqlalchemy/engine/default.py", line 623, in _init_compiled
  File "build/bdist.macosx-10.12-x86_64/egg/sqlalchemy/sql/type_api.py", line 1074, in process
  File "build/bdist.macosx-10.12-x86_64/egg/sqlalchemy_utc.py", line 31, in process_bind_param
sqlalchemy.exc.StatementError: (exceptions.ValueError) naive datetime is disallowed [SQL: u'SELECT task_instance.try_number AS task_instance_try_number, task_instance.task_id AS task_instance_task_id, task_instance.dag_id AS task_instance_dag_id, task_instance.execution_date AS task_instance_execution_date, task_instance.start_date AS task_instance_start_date, task_instance.end_date AS task_instance_end_date, task_instance.duration AS task_instance_duration, task_instance.state AS task_instance_state, task_instance.max_tries AS task_instance_max_tries, task_instance.hostname AS task_instance_hostname, task_instance.unixname AS task_instance_unixname, task_instance.job_id AS task_instance_job_id, task_instance.pool AS task_instance_pool, task_instance.queue AS task_instance_queue, task_instance.priority_weight AS task_instance_priority_weight, task_instance.operator AS task_instance_operator, task_instance.queued_dttm AS task_instance_queued_dttm, task_instance.pid AS task_instance_pid \nFROM task_instance \nWHERE task_instance.dag_id = ? AND task_instance.task_id = ? AND task_instance.execution_date = ?\n LIMIT ? OFFSET ?'] [parameters: [{}]]
Run Code Online (Sandbox Code Playgroud)

现在要求的格式是什么sqlAlchemy?(这似乎是一个失踪的问题timezone- 所以我也在调查这个..)

S'c*_*ock 7

根据 python 的官方文档,有两种类型的日期时间对象 - 感知型和天真型

\n

https://docs.python.org/3/library/datetime.html

\n

日期和时间对象可以分类为 \xe2\x80\x9caware\xe2\x80\x9d 或 \xe2\x80\x9cnaive\xe2\x80\x9d,具体取决于它们是否包含时区信息。

\n

请参阅下面的示例 -

\n
from datetime import datetime, timezone\ndate_aware = datetime.now(timezone.utc)\ndate_naive = datetime.now()\noutput of \'date_aware.tzinfo\' is datetime.timezone.utc    \noutput of \'date_naive.tzinfo\' is None\n
Run Code Online (Sandbox Code Playgroud)\n

https://docs.python.org/3/library/datetime.html#defining-if-an-object-is-aware-or-naive

\n


jav*_*dba 5

类似以下的格式正在运行:

'2017-12-28T12:27:00Z'
Run Code Online (Sandbox Code Playgroud)

其中第一部分是日期,然后是时间戳T,然后是时区信息。