无法找到或加载主类org.apache.giraph.yarn.GiraphApplicationMaster

Question

我正在尝试让Giraph在YARN集群上运行(Hadoop 2.5.2),但我遇到了这个错误:

Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster

我已经尝试了以前关于这个主题的消息中找到的所有内容,但无济于事.我的命令行是这样的:

hadoop jar /home/prhodes/giraph/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/prhodes/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/prhodes/giraph_output/shortestpaths -w 4 -yj /home/prhodes/giraph/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar,/home/prhodes/giraph/giraph-core/target/giraph-1.2.0-SNAPSHOT-for-hadoop-2.5.2-jar-with-dependencies.jar

我已经检查过这些jar是在群集中每个节点上的那些位置.另外,我已经验证了jar文件确实包含GiraphApplicationMaster.class.然而它仍然抱怨没有找到GiraphApplicationMaster.

有什么想法可能导致问题,或任何解决方法？我考虑过将Giraph jar分发到每个节点并将它们物理地放在Hadoop Classpath上,但默认情况下Maven build会构建fat jar,这可能会导致问题.还有其他建议或想法吗？

Answer 1

我用命令解决了这个问题:

cp $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-2.6.0-jar-with-dependencies.jar $HADOOP_HOME/share/hadoop/yarn/lib/

cp $GIRAPH_HOME/giraph-examples/target/ $HADOOP_HOME/share/hadoop/yarn/lib/

然后,运行你的工作