相关疑难解决方法(0)

我Hadoop 2.6.0.2.2.0.0-2041用Hive 0.14.0.2.2.0.0-2041 After命令构建Spark:

mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -Phive-thriftserver -DskipTests package

我尝试使用以下命令在YARN上运行Pi示例:

export HADOOP_CONF_DIR=/etc/hadoop/conf
/var/home2/test/spark/bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--master yarn-cluster \
--executor-memory 3G \
--num-executors 50 \
hdfs:///user/test/jars/spark-examples-1.3.0-hadoop2.4.0.jar \
1000

我得到例外:application_1427875242006_0029 failed 2 times due to AM Container for appattempt_1427875242006_0029_000002 exited with exitCode: 1事实上是这样Diagnostics: Exception from container-launch.(请参阅下面的日志).

应用程序跟踪网址显示以下消息:

java.lang.Exception: Unknown container. Container either has not started or has already completed or doesn't belong to this node at all

并且:

Error: Could …