小编Ahm*_*dn1的帖子

pyspark SparkContext问题“正在构建另一个SparkContext”

我按照本教程在 EC2 实例上安装了 Spark: https:
//sparkour.urizone.net/recipes/installing-ec2/#03
,但是当我尝试启动 pyspark shell 时,出现此错误:
“正在构建另一个 SparkContext”

这是完整的异常:

[ec2-user@ip-10-0-0-153 ~]$ pyspark
Python 2.7.12 (default, Sep  1 2016, 22:14:00) 
[GCC 4.8.3 20140911 (Red Hat 4.8.3-9)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/08/22 11:46:16 WARN spark.SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor).  This may indicate an error, since only one …
Run Code Online (Sandbox Code Playgroud)

amazon-ec2 apache-spark pyspark

7
推荐指数
1
解决办法
1万
查看次数

标签 统计

amazon-ec2 ×1

apache-spark ×1

pyspark ×1