小编ami*_*wdh的帖子

我的工具版本是：

Version: IntelliJ 2020.01
Gradle Version: 5.3

这是错误：

Could not initialize class `org.codehaus.groovy.classgen.Verifier`

这是完整的堆栈跟踪：

FAILURE: Build failed with an exception.

* What went wrong:
Could not open cp_init remapped class cache for cu8zodz9lhma9nl4f6h0p0tmj (/home/wadhe/.gradle/caches/6.2/scripts-remapped/sync_studio_tooling3_3txli0t8xc4p0cha8vbu3368/cu8zodz9lhma9nl4f6h0p0tmj/cp_initcf39471ad2848fb82befe662c0627ed4).
> Could not open cp_init generic class cache for initialization script '/tmp/sync.studio.tooling3.gradle' (/home/wadhe/.gradle/caches/6.2/scripts/cu8zodz9lhma9nl4f6h0p0tmj/cp_init/cp_initcf39471ad2848fb82befe662c0627ed4).
   > Could not initialize class org.codehaus.groovy.classgen.Verifier

* Try:
Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Exception is:
org.gradle.cache.CacheOpenException: Could not open …

无法从 Spark 流应用程序向 Kafka 主题发送 avro 格式消息。关于 avro spark 流示例代码的在线信息非常少。“to_avro”方法不需要 avro 模式，那么它将如何编码为 avro 格式？

有人可以帮助解决以下异常吗？

依赖：

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-avro_2.12</artifactId>
    <version>2.4.4</version>
</dependency>
<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-core_2.11</artifactId>
    <version>2.4.0</version>
</dependency>
<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-streaming-kafka-0-10_2.11</artifactId>
    <version>2.4.0</version>
</dependency>

下面是推送到kafka主题的代码

dataset.toDF.select(to_avro(struct(dataset.toDF.columns.map(column):_*))).alias("value").distinct.write.format("avro")
      .option(KafkaConstants.BOOTSTRAP_SERVER, priBootStrapServers)
      .option(ApplicationConstants.TOPIC_KEY, publishPriTopic)
      .save()

低于异常。

Caused by: java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.avro.AvroFileFormat could not be instantiated
    at java.util.ServiceLoader.fail(ServiceLoader.java:232)
    at java.util.ServiceLoader.access$100(ServiceLoader.java:185)
    at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)
    at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
    at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
    at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:43)
    at scala.collection.Iterator$class.foreach(Iterator.scala:893)
    at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
    at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
    at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
    at scala.collection.TraversableLike$class.filterImpl(TraversableLike.scala:247)
    at scala.collection.TraversableLike$class.filter(TraversableLike.scala:259)
    at scala.collection.AbstractTraversable.filter(Traversable.scala:104)
    at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:614)
    at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:241)
    at …