当我启动Spark shell时:
bin>./spark-shell
Run Code Online (Sandbox Code Playgroud)
我收到以下错误:
Spark assembly has been built with Hive, including Data nucleus jars on classpath
Welcome to SPARK VERSION 1.3.0
Using Scala version 2.10.4 (Java HotSpot(TM) Server VM, Java 1.7.0_75)
Type in expressions to have them evaluated.
Type :help for more information.
15/05/10 12:12:21 ERROR SparkDeploySchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
15/05/10 12:12:21 ERROR TaskSchedulerImpl: Exiting due to error from cluster scheduler: All masters are unresponsive! Giving up.
Run Code Online (Sandbox Code Playgroud)
我已经通过以下链接安装了spark:-http: //www.philchen.com/2015/02/16/how-to-install-apache-spark-and-cassandra-stack-on-ubuntu
启动时,您应该提供Spark Cluster的主URL。 spark-shell
至少:
bin/spark-shell --master spark://master-ip:7077
Run Code Online (Sandbox Code Playgroud)
所有选项组成一长串,您可以自己找到合适的选项:
bin/spark-shell --help
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
8634 次 |
| 最近记录: |