小编Joj*_*dan的帖子

run-main-0) scala.ScalaReflectionException: JavaMirror 中的类 java.sql.Date 与 ClasspathFilter(

你好,我有一份老师给我的文件。这是关于 Scala 和 Spark 的。当我运行代码时,它给了我这个异常:

  (run-main-0) scala.ScalaReflectionException: class java.sql.Date in 
  JavaMirror with ClasspathFilter 
Run Code Online (Sandbox Code Playgroud)

文件本身如下所示:

import org.apache.spark.ml.feature.Tokenizer
import org.apache.spark.sql.Dataset
import org.apache.spark.sql.SparkSession
import org.apache.spark.sql.types._
object Main {
   type Embedding       = (String, List[Double])
   type ParsedReview    = (Integer, String, Double)
   org.apache.log4j.Logger getLogger "org"  setLevel 
   (org.apache.log4j.Level.WARN)
   org.apache.log4j.Logger getLogger "akka" setLevel 
  (org.apache.log4j.Level.WARN)
   val spark =  SparkSession.builder
     .appName ("Sentiment")
     .master  ("local[9]")
     .getOrCreate

import spark.implicits._

val reviewSchema = StructType(Array(
        StructField ("reviewText", StringType, nullable=false),
        StructField ("overall",    DoubleType, nullable=false),
        StructField ("summary",    StringType, nullable=false)))

// Read file and merge the text …
Run Code Online (Sandbox Code Playgroud)

scala apache-spark

5
推荐指数
1
解决办法
1102
查看次数

标签 统计

apache-spark ×1

scala ×1