我遇到错误Expected HTTP 101 response but was '403 Forbidden'在我设置一个新的Kubernetes集群并Kubeadm使用一个主服务器和两个工作器后,我提交了pyspark示例应用程序,遇到以下ERROR消息:
spark-submit命令
spark-submit --master k8s://master-host:port \
--deploy-mode cluster --name test-pyspark \
--conf spark.kubernetes.container.image=mm45/pyspark-k8s-example:2.4.1 \
--conf spark.kubernetes.pyspark.pythonVersion=3 \
--conf spark.executor.instances=1 \
--conf spark.executor.memory=1000m \
--conf spark.driver.memory=1000m \
--conf spark.executor.cores=1 \
--conf spark.driver.cores=1 \
--conf spark.driver.maxResultSize=10g /usr/bin/run.py
Run Code Online (Sandbox Code Playgroud)
错误详情:
19/08/24 19:38:06 WARN WatchConnectionManager: Exec Failure: HTTP 403, Status: 403 -
java.net.ProtocolException: Expected HTTP 101 response but was '403 Forbidden'
Run Code Online (Sandbox Code Playgroud)
群集详细信息:
群集角色绑定:
apiVersion: rbac.authorization.k8s.io/v1beta1
kind: ClusterRoleBinding
metadata:
name: …Run Code Online (Sandbox Code Playgroud)