小编use*_*975的帖子

Python Luigi LocalTarget泡菜

我在Windows 7,通过Anaconda 4.3.17,Luigi 2.4.0,Pandas 0.18,sklearn版本0.18的Python 2.7上运行。在下面,我试图将luigi.LocalTarget输出作为一个腌菜来存储一些不同的对象(使用firstJob),然后在一个依赖的作业(secondJob)中从该腌菜中读取。如果我从命令行运行以下命令,则firstJob成功完成:

“ python -m luigi --module luigiPickle firstJob --date 2017-06-07 --local-scheduler”

但是,如果我尝试运行secondJob,即

“ python -m luigi --module luigiPickle secondJob --date 2017-06-07 --local-scheduler”

我懂了

Traceback (most recent call last):
  File "C:\Anaconda2\lib\site-packages\luigi-2.4.0-py2.7.egg\luigi\worker.py", l
ine 191, in run
    new_deps = self._run_get_new_deps()
  File "C:\Anaconda2\lib\site-packages\luigi-2.4.0-py2.7.egg\luigi\worker.py", l
ine 129, in _run_get_new_deps
    task_gen = self.task.run()
  File "luigiPickle.py", line 41, in run
    ret2 = pickle.load(inFile)
  File "C:\Anaconda2\lib\pickle.py", line 1384, in load
    return Unpickler(file).load()
  File "C:\Anaconda2\lib\pickle.py", line 864, in load
    dispatch[key](self)
  File "C:\Anaconda2\lib\pickle.py", line …
Run Code Online (Sandbox Code Playgroud)

pickle python-2.7 luigi

4
推荐指数
1
解决办法
1114
查看次数

标签 统计

luigi ×1

pickle ×1

python-2.7 ×1