小编Pan*_*kaj的帖子

Spark 1.2.1独立集群模式spark-submit不起作用

我有3个节点火花簇

node1,node2和node3

我在节点1上运行以下命令来部署驱动程序

/usr/local/spark-1.2.1-bin-hadoop2.4/bin/ spark-submit--class com.fst.firststep.aggregator.FirstStepMessageProcessor --master spark://ec2-xx-xx-xx-xx.compute- 1.amazonaws.com:7077 - 部署模式集群--supervise文件:///home/xyz/sparkstreaming-0.0.1-SNAPSHOT.jar /home/xyz/config.properties

驱动程序在集群中的节点2上启动.但是在节点2上获得它试图绑定到节点1 ip的异常.

2015-02-26 08:47:32 DEBUG AkkaUtils:63 - In createActorSystem, requireCookie is: off 
2015-02-26 08:47:32 INFO  Slf4jLogger:80 - Slf4jLogger started 
2015-02-26 08:47:33 ERROR NettyTransport:65 - failed to bind to ec2-xx.xx.xx.xx.compute-1.amazonaws.com/xx.xx.xx.xx:0, shutting down Netty transport 
2015-02-26 08:47:33 WARN  Utils:71 - Service 'Driver' could not bind on port 0. Attempting port 1. 
2015-02-26 08:47:33 DEBUG AkkaUtils:63 - In createActorSystem, requireCookie is: off 
2015-02-26 08:47:33 ERROR Remoting:65 - Remoting error: [Startup …
Run Code Online (Sandbox Code Playgroud)

apache-spark

2
推荐指数
1
解决办法
3061
查看次数

标签 统计

apache-spark ×1