小编jmo*_*255的帖子

Google Cloud Dataflow Python,检索作业 ID

我目前正在使用Python处理数据流模板,我想访问作业 ID 并使用它来保存到特定的 Firestore 文档。

是否可以访问作业 ID?

我在文档中找不到与此相关的任何内容。

python google-cloud-platform google-cloud-dataflow

3
推荐指数
1
解决办法
2514
查看次数

ImportError:尝试将数据提交到数据流中的 firestore 时,没有名为 firebase_admin 的模块

我目前正在尝试将数据从我的 python apache beam 数据流管道提交到 firestore。

但我一直收到错误:

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
    work_executor.execute()
  File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
    op.start()
  File "dataflow_worker/shuffle_operations.py", line 49, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
    def start(self):
  File "dataflow_worker/shuffle_operations.py", line 50, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
    with self.scoped_start_state:
  File "dataflow_worker/shuffle_operations.py", line 65, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
    with self.shuffle_source.reader() as reader:
  File "dataflow_worker/shuffle_operations.py", line 69, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
    self.output(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 159, in apache_beam.runners.worker.operations.Operation.output
    cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 85, in apache_beam.runners.worker.operations.ConsumerSet.receive
    cython.cast(Operation, consumer).process(windowed_value)
  File "dataflow_worker/shuffle_operations.py", line 233, in …
Run Code Online (Sandbox Code Playgroud)

python importerror firebase google-cloud-platform google-cloud-firestore

0
推荐指数
1
解决办法
3337
查看次数