小编ibr*_*him的帖子

ValueError:无法使用pyspark一次在火花中运行多个SparkContext

我是使用Spark的新手,我尝试在pyspark上运行此代码

from pyspark import SparkConf, SparkContext
import collections

conf = SparkConf().setMaster("local").setAppName("RatingsHistogram")
sc = SparkContext(conf = conf)
Run Code Online (Sandbox Code Playgroud)

但是他直到我这个错误信息

Using Python version 3.5.2 (default, Jul  5 2016 11:41:13)
SparkSession available as 'spark'.
>>> from pyspark import SparkConf, SparkContext
>>> import collections
>>> conf = SparkConf().setMaster("local").setAppName("RatingsHistogram")
>>> sc = SparkContext(conf = conf)



   Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "C:\spark\python\pyspark\context.py", line 115, in __init__
        SparkContext._ensure_initialized(self, gateway=gateway, conf=conf)
      File "C:\spark\python\pyspark\context.py", line 275, in _ensure_initialized
        callsite.function, callsite.file, callsite.linenum))
    ValueError: Cannot …
Run Code Online (Sandbox Code Playgroud)

python-3.x apache-spark pyspark

5
推荐指数
3
解决办法
6453
查看次数

标签 统计

apache-spark ×1

pyspark ×1

python-3.x ×1