小编Fen*_*eng的帖子

我可以成功运行java版本的pi示例,如下所示.

./bin/spark-submit --class org.apache.spark.examples.SparkPi \ 
    --master yarn-client \ 
    --num-executors 3 \ 
    --driver-memory 4g \ 
    --executor-memory 2g \ 
    --executor-cores 1 \ 
    --queue thequeue \ 
    lib/spark-examples*.jar \ 
    10 

但是,python版本失败,出现以下错误信息.我使用了纱线客户端模式.具有yarn-client模式的pyspark命令行返回相同的信息.任何人都可以帮我解决这个问题吗？

nlp@yyy2:~/spark$ ./bin/spark-submit --master yarn-client examples/src/main/python/pi.py 
15/01/05 17:22:26 INFO spark.SecurityManager: Changing view acls to: nlp 
15/01/05 17:22:26 INFO spark.SecurityManager: Changing modify acls to: nlp 
15/01/05 17:22:26 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(nlp); users with modify permissions: Set(nlp) 
15/01/05 17:22:26 INFO slf4j.Slf4jLogger: Slf4jLogger started 
15/01/05 17:22:26 INFO Remoting: …