小编Jia*_*Jia的帖子

Mac spark-shell初始化SparkContext时出错

我尝试在Mac OS Yosemite 10.10.5上使用spark 1.6.0(spark-1.6.0-bin-hadoop2.4)启动

"./bin/spark-shell". 
Run Code Online (Sandbox Code Playgroud)

它有以下错误.我也尝试安装不同版本的Spark,但都有相同的错误.这是我第二次运行Spark.我之前的运行正常.

log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's repl log4j profile: org/apache/spark/log4j-defaults-repl.properties
To adjust logging level use sc.setLogLevel("INFO")
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 1.6.0
      /_/

Using Scala version 2.10.5 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_79)
Type in expressions to have …
Run Code Online (Sandbox Code Playgroud)

apache-spark

72
推荐指数
8
解决办法
5万
查看次数

如何在Graphviz中绘制重叠的簇?

我正在尝试使用GraphViz绘制图形模型.但是,我没有找到一种方法来绘制重叠簇.例如,如何使"nodeA-> nodeB"位于clusterA和clusterB中?

graphviz

6
推荐指数
1
解决办法
1866
查看次数

PredictionIO pio状态:Zookeeper存在失败

我通过$ bash -c"$(curl -s https://install.prediction.io/install.sh)安装PredictionIO "

当我做pio状态时,它显示以下消息:

[INFO] [Console$] Inspecting PredictionIO...
[INFO] [Console$] PredictionIO 0.9.5 is installed at /Users/jia.huang/PredictionIO
[INFO] [Console$] Inspecting Apache Spark...
[INFO] [Console$] Apache Spark is installed at /Users/jia.huang/PredictionIO/vendors/spark-1.5.1
[INFO] [Console$] Apache Spark 1.5.1 detected (meets minimum requirement of 1.3.0)
[INFO] [Console$] Inspecting storage backend connections...
[INFO] [Storage$] Verifying Meta Data Backend (Source: ELASTICSEARCH)...
[INFO] [Storage$] Verifying Model Data Backend (Source: LOCALFS)...
[INFO] [Storage$] Verifying Event Data Backend (Source: HBASE)...
[ERROR] [RecoverableZooKeeper] …
Run Code Online (Sandbox Code Playgroud)

hbase predictionio apache-zookeeper

1
推荐指数
1
解决办法
2346
查看次数