我在Windows 7,通过Anaconda 4.3.17,Luigi 2.4.0,Pandas 0.18,sklearn版本0.18的Python 2.7上运行。在下面,我试图将luigi.LocalTarget输出作为一个腌菜来存储一些不同的对象(使用firstJob),然后在一个依赖的作业(secondJob)中从该腌菜中读取。如果我从命令行运行以下命令,则firstJob成功完成:
“ python -m luigi --module luigiPickle firstJob --date 2017-06-07 --local-scheduler”
但是,如果我尝试运行secondJob,即
“ python -m luigi --module luigiPickle secondJob --date 2017-06-07 --local-scheduler”
我懂了
Traceback (most recent call last):
File "C:\Anaconda2\lib\site-packages\luigi-2.4.0-py2.7.egg\luigi\worker.py", l
ine 191, in run
new_deps = self._run_get_new_deps()
File "C:\Anaconda2\lib\site-packages\luigi-2.4.0-py2.7.egg\luigi\worker.py", l
ine 129, in _run_get_new_deps
task_gen = self.task.run()
File "luigiPickle.py", line 41, in run
ret2 = pickle.load(inFile)
File "C:\Anaconda2\lib\pickle.py", line 1384, in load
return Unpickler(file).load()
File "C:\Anaconda2\lib\pickle.py", line 864, in load
dispatch[key](self)
File "C:\Anaconda2\lib\pickle.py", line …Run Code Online (Sandbox Code Playgroud)