我正在使用示例程序yarn-cluster作为主人对纱线群进行烟雾测试SparkPi.这是命令行:
$SPARK_HOME/bin/spark-submit --master yarn-cluster
--executor-memory 8G --executor-cores 240 --class org.apache.spark.examples.SparkPi
Run Code Online (Sandbox Code Playgroud)
实例/目标/阶-2.11 /火花例子-1.4.1-hadoop2.7.1.jar
纱线接受了这项工作,但后来抱怨"不良替代".也许是在hdp.version??
15/09/01 21:54:05 INFO yarn.Client: Application report for application_1441066518301_0013 (state: ACCEPTED)
15/09/01 21:54:05 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1441144443866
final status: UNDEFINED
tracking URL: http://yarnmaster-8245.lvs01.dev.ebayc3.com:8088/proxy/application_1441066518301_0013/
user: stack
15/09/01 21:54:06 INFO yarn.Client: Application report for application_1441066518301_0013 (state: ACCEPTED)
15/09/01 21:54:10 INFO yarn.Client: Application report for application_1441066518301_0013 (state: FAILED) …Run Code Online (Sandbox Code Playgroud)