小编Moh*_*ina的帖子

Kubernetes WatchConnectionManager:执行失败:HTTP 403

我遇到错误Expected HTTP 101 response but was '403 Forbidden'在我设置一个新的Kubernetes集群并Kubeadm使用一个主服务器和两个工作器后,我提交了pyspark示例应用程序,遇到以下ERROR消息:

spark-submit命令

spark-submit --master k8s://master-host:port \
--deploy-mode cluster --name test-pyspark \
--conf spark.kubernetes.container.image=mm45/pyspark-k8s-example:2.4.1 \
--conf spark.kubernetes.pyspark.pythonVersion=3 \
--conf spark.executor.instances=1 \
--conf spark.executor.memory=1000m \
--conf spark.driver.memory=1000m \
--conf spark.executor.cores=1 \
--conf spark.driver.cores=1 \
--conf spark.driver.maxResultSize=10g /usr/bin/run.py
Run Code Online (Sandbox Code Playgroud)

错误详情:

19/08/24 19:38:06 WARN WatchConnectionManager: Exec Failure: HTTP 403, Status: 403 -
java.net.ProtocolException: Expected HTTP 101 response but was '403 Forbidden'
Run Code Online (Sandbox Code Playgroud)

群集详细信息:

  1. Kubernetes版本1.13.0
  2. Spark版本2.4.1
  3. 云平台:在EC2上运行的AWS

群集角色绑定:

apiVersion: rbac.authorization.k8s.io/v1beta1
kind: ClusterRoleBinding
metadata:
  name: …
Run Code Online (Sandbox Code Playgroud)

rbac apache-spark fabric8 kubernetes kubeadm

2
推荐指数
1
解决办法
1798
查看次数

标签 统计

apache-spark ×1

fabric8 ×1

kubeadm ×1

kubernetes ×1

rbac ×1