小编Jon*_*ruz的帖子

Pig 0.13 ERROR 2998:未处理的内部错误.组织/阿帕奇/的Hadoop/MapReduce的/任务/ JobContextImpl

刚刚安装了Pig 0.13,我试图将它与Hadoop 1.1.2一起使用.(Pig文档说Pig 0.13与Hadoop 1.1.2兼容).根据Pig安装说明,我将$ PIG_CLASSPATH设置为指向/ etc/hadoop,其中定义了core-site.xml,hdfs-site.xml和mapred-site.xml.Hadoop集群功能齐全,适用于非Pig作业.基于下面的错误描述,我理解Pig找不到它正在寻找的JobContextImpl类.

基于Hadoop 1.1.2 API文档,我不认为"task"是"mapreduce"包的子包.我已经尝试将hadoop-core-1.1.2.jar直接添加到$ PIG_CLASSPATH,但这不起作用.(在查看hadoop-core-1.1.2.jar和Hadoop 1.1.2 API文档的内容之后,我不认为在Pig试图从中加载它的包中定义了JobContextImpl).如何让Pig 0.13与Hadoop 1.1.2一起使用?

=======错误如下所示=======

14/08/03 14:01:05 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/08/03 14:01:05 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/08/03 14:01:05 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-08-03 14:01:05,959 [main] INFO  org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-08-03 14:01:05,959 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/hadoop/pig-0.13.0/bin/pig_1407088865958.log
2014-08-03 14:01:06,112 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: …
Run Code Online (Sandbox Code Playgroud)

hadoop apache-pig

7
推荐指数
1
解决办法
1659
查看次数

标签 统计

apache-pig ×1

hadoop ×1