我在Java中运行一个简单的spark程序(IDE:Eclipse Luna,Maven).
我的示例程序是
import org.apache.spark.SparkConf;
import org.apache.spark.api.java.JavaSparkContext;
public class testSpark {
public static void main(String[] args) {
SparkConf conf = new SparkConf().setAppName("Testing").setMaster("local");
JavaSparkContext sc = new JavaSparkContext(conf);
System.out.println(sc.appName());
}
}
Run Code Online (Sandbox Code Playgroud)
但是我在运行示例程序时遇到错误
线程"main"中的异常java.lang.NoClassDefFoundError:org.apache.spark.ui.jobs.JobsTab中的scala/xml/MetaData(JobsTab.scala:30)org.apache.spark.ui.SparkUI.initialize( SparkUI.scala:50)在iScope.testSpark.main上的org.apache.spark.ui.SparkUI.(SparkUI.scala:61)(testSpark.java:9)
引起:java.lang.ClassNotFoundException:java.lang.ClassLoader.loadClass(未知来源)java.net.URLClassLoader.findClass(未知来源)的scala.xml.MetaData
我的pom.xml文件是
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_2.11</artifactId>
<version>1.2.1</version>
</dependency>
<dependency>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
<version>18.0</version>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-mllib_2.11</artifactId>
<version>1.2.1</version>
</dependency>
Run Code Online (Sandbox Code Playgroud) 我正在使用Eclipse Luna.当我通过maven添加"番石榴"时,我收到此错误
Missing artifact com.google.guava:guava:bundle:18.0
Run Code Online (Sandbox Code Playgroud)
我关注了Central Repository.我更新了相同,但仍然得到相同的错误.
我对pom.xml文件的依赖:
<dependency>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
<version>18.0</version>
<type>bundle</type>
</dependency>
Run Code Online (Sandbox Code Playgroud)