在本地计算机上独立启动 spark 时遇到问题。我正在遵循本手册,这非常简单,但我仍然缺少一些东西
当我运行 start-master.sh 时,它显示以下错误:
couto@ubuntu:~/Downloads/spark-1.6.2-bin-hadoop2.4/sbin$ sh start-master.sh
start-master.sh: 31: start-master.sh: [[: not found
start-master.sh: 31: start-master.sh: [[: not found
start-master.sh: 45: start-master.sh: 0: not found
start-master.sh: 52: /home/couto/Downloads/spark-1.6.2-bin-hadoop2.4/bin/load-spark-env.sh: [[: not found
starting org.apache.spark.deploy.master.Master, logging to /home/couto/Downloads/spark-1.6.2-bin-hadoop2.4/logs/spark-couto-org.apache.spark.deploy.master.Master-1-ubuntu.out
start-master.sh: 78: [: false: unexpected operator
Run Code Online (Sandbox Code Playgroud)
尽管如此,主人似乎运行正确:
但是,一旦我尝试启动从站,它就会显示以下错误,并且 spark 控制台中不包含从站。
couto@ubuntu:~/Downloads/spark-1.6.2-bin-hadoop2.4/sbin$ sh start-slave.sh spark://localhost:7077
start-slave.sh: 42: start-slave.sh: [[: not found
start-slave.sh: 42: start-slave.sh: [[: not found
start-slave.sh: 42: start-slave.sh: [[: not found
start-slave.sh: 52: /home/couto/Downloads/spark-1.6.2-bin-hadoop2.4/bin/load-spark-env.sh: [[: not found
start-slave.sh: 68: start-slave.sh: function: not found
start-slave.sh: 70: shift: can't shift that many
Run Code Online (Sandbox Code Playgroud)
我正在使用 jdk 1.8.0_91 Spark:spark-1.6.2-bin-hadoop2.4(我也尝试过使用 hadoop2.6 的预构建版本)
按照第一条评论中的建议使用 start-all.sh :
couto@ubuntu:~/Downloads/spark-1.6.2-bin-hadoop2.4/sbin$ sh start-all.sh
start-all.sh: 30: start-all.sh: 0: not found
starting org.apache.spark.deploy.master.Master, logging to /home/couto/Downloads/spark-1.6.2-bin-hadoop2.4/logs/spark-couto-org.apache.spark.deploy.master.Master-1-ubuntu.out
localhost: ssh: connect to host localhost port 22: Connection refused
Run Code Online (Sandbox Code Playgroud)
你能给我一些指示吗?
SCo*_*uto 10
运行如下它工作正常
bash start-master.sh
bash start-slave.sh spark://localhost:7077
Run Code Online (Sandbox Code Playgroud)
亲切的问候
| 归档时间: |
|
| 查看次数: |
6462 次 |
| 最近记录: |