小编pup*_*pet的帖子

Spark-submit ClassNotFound异常

使用这个简单的例子,我遇到了"ClassNotFound"异常的问题:

import org.apache.spark.SparkContext
import org.apache.spark.SparkContext._
import org.apache.spark.SparkConf

import java.net.URLClassLoader

import scala.util.Marshal

class ClassToRoundTrip(val id: Int) extends scala.Serializable {
}

object RoundTripTester {

  def test(id : Int) : ClassToRoundTrip = {

    // Get the current classpath and output. Can we see simpleapp jar?
    val cl = ClassLoader.getSystemClassLoader
    val urls = cl.asInstanceOf[URLClassLoader].getURLs
    urls.foreach(url => println("Executor classpath is:" + url.getFile))

    // Simply instantiating an instance of object and using it works fine.
    val testObj = new ClassToRoundTrip(id)
    println("testObj.id: " + testObj.id)

    val testObjBytes …
Run Code Online (Sandbox Code Playgroud)

scala jar classpath apache-spark

21
推荐指数
1
解决办法
4万
查看次数

标签 统计

apache-spark ×1

classpath ×1

jar ×1

scala ×1