小编meh*_*hdi的帖子

为什么apache spark不适用于java 10?我们得到非法反映然后java.lang.IllegalArgumentException

有什么技术原因为什么spark 2.3不适用于java 1.10(截至2018年7月)?

这是我运行SparkPi示例时的输出spark-submit.

$ ./bin/spark-submit ./examples/src/main/python/pi.py 
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2018-07-13 14:31:30 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-07-13 14:31:31 …
Run Code Online (Sandbox Code Playgroud)

java jvm apache-spark

12
推荐指数
2
解决办法
7834
查看次数

标签 统计

apache-spark ×1

java ×1

jvm ×1