小编axr*_*xrd的帖子

BigQuery with Airflow - 缺少projectId

尝试下面的例子:

https://cloud.google.com/blog/big-data/2017/07/how-to-aggregate-data-for-bigquery-using-apache-airflow

运行命令之一时:

airflow test bigquery_github_trends_v1 bq_check_githubarchive_day 2017-06-02
Run Code Online (Sandbox Code Playgroud)

收到错误:TypeError:缺少所需参数“projectId”

错误堆栈:

[2017-09-11 16:32:26,630] {models.py:1126} INFO - Dependencies all met for <TaskInstance: bigquery_github_trends_v1.bq_check_githubarchive_day 2017-06-02 00:00:00 [None]>
[2017-09-11 16:32:26,631] {models.py:1126} INFO - Dependencies all met for <TaskInstance: bigquery_github_trends_v1.bq_check_githubarchive_day 2017-06-02 00:00:00 [None]>
[2017-09-11 16:32:26,632] {models.py:1318} INFO - 
-----------------------------------------------------------------------
---------
Starting attempt 1 of 6
-----------------------------------------------------------------------
---------

[2017-09-11 16:32:26,632] {models.py:1342} INFO - Executing <Task(BigQueryCheckOperator): bq_check_githubarchive_day> on 2017-06-02 00:00:00
[2017-09-11 16:32:26,643] {check_operator.py:75} INFO - Executing SQL check: 
#legacySql
SELECT table_id 
FROM [githubarchive:day.__TABLES__] 
WHERE table_id = …
Run Code Online (Sandbox Code Playgroud)

google-bigquery airflow

3
推荐指数
1
解决办法
6690
查看次数

标签 统计

airflow ×1

google-bigquery ×1