相关疑难解决方法(0)

向火线集群提交火花工作时的"不良替代"

我正在使用示例程序yarn-cluster作为主人对纱线群进行烟雾测试SparkPi.这是命令行:

  $SPARK_HOME/bin/spark-submit --master yarn-cluster 
 --executor-memory 8G --executor-cores 240 --class org.apache.spark.examples.SparkPi 
Run Code Online (Sandbox Code Playgroud)

实例/目标/阶-2.11 /火花例子-1.4.1-hadoop2.7.1.jar

纱线接受了这项工作,但后来抱怨"不良替代".也许是在hdp.version??

15/09/01 21:54:05 INFO yarn.Client: Application report for application_1441066518301_0013 (state: ACCEPTED)
15/09/01 21:54:05 INFO yarn.Client:
     client token: N/A
     diagnostics: N/A
     ApplicationMaster host: N/A
     ApplicationMaster RPC port: -1
     queue: default
     start time: 1441144443866
     final status: UNDEFINED
     tracking URL: http://yarnmaster-8245.lvs01.dev.ebayc3.com:8088/proxy/application_1441066518301_0013/
     user: stack
15/09/01 21:54:06 INFO yarn.Client: Application report for application_1441066518301_0013 (state: ACCEPTED)
15/09/01 21:54:10 INFO yarn.Client: Application report for application_1441066518301_0013 (state: FAILED) …
Run Code Online (Sandbox Code Playgroud)

hadoop-yarn apache-spark

12
推荐指数
3
解决办法
7496
查看次数

标签 统计

apache-spark ×1

hadoop-yarn ×1