role.rbac.authorization.k8s.io 甚至被添加到 apiGroups 中也是被禁止的

Question

我正在运行 kubernetes v1.11.5，并且正在为每个命名空间安装带有分蘖部署的 helm。让我们专注于单个命名空间。这是分蘖服务帐户配置：

---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: tiller
  namespace: marketplace-int
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: tiller-manager
  namespace: marketplace-int
rules:
- apiGroups:
  - ""
  - extensions
  - apps
  - rbac.authorization.k8s.io
  - roles.rbac.authorization.k8s.io
  - authorization.k8s.io
  resources: ["*"]
  verbs: ["*"]
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: tiller-binding
  namespace: marketplace-int
subjects:
- kind: ServiceAccount
  name: tiller
  namespace: marketplace-int
roleRef:
  kind: Role
  name: tiller-manager
  apiGroup: rbac.authorization.k8s.io

当我尝试部署图表时，出现此错误：

Error: release citest failed: roles.rbac.authorization.k8s.io "marketplace-int-role-ns-admin" is forbidden: 
attempt to grant extra privileges: 
[{[*] [*] [*] [] []}] user=&{system:serviceaccount:marketplace-int:tiller 5c6af739-1023-11e9-a245-0ab514dfdff4 
[system:serviceaccounts system:serviceaccounts:marketplace-int system:authenticated] map[]} 
ownerrules=[{[create] [authorization.k8s.io] [selfsubjectaccessreviews selfsubjectrulesreviews] [] []} 
{[get] [] [] [] [/api /api/* /apis /apis/* /healthz /openapi /openapi/* /swagger-2.0.0.pb-v1 /swagger.json /swaggerapi /swaggerapi/* /version /version/]} 
{[*] [ extensions apps rbac.authorization.k8s.io roles.rbac.authorization.k8s.io authorization.k8s.io] [*] [] []}] ruleResolutionErrors=[]

尝试为该命名空间创建 rbac 配置时出现错误（使用tiller sa）：

# Source: marketplace/templates/role.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
  labels:
    app: citest
    chart: marketplace-0.1.0
    heritage: Tiller
    release: citest
    namespace: marketplace-int
  name: marketplace-int-role-ns-admin
rules:
  - apiGroups: ["*"]
    resources: ["*"]
    verbs: ["*"]

错误消息清楚地表明分蘖服务帐户没有权限，roles.rbac.authorization.k8s.io但如前所示授予了该权限。

$kubectl describe role tiller-manager
Name:         tiller-manager
Labels:       <none>
Annotations:  kubectl.kubernetes.io/last-applied-configuration:
                {"apiVersion":"rbac.authorization.k8s.io/v1","kind":"Role","metadata":{"annotations":{},"name":"tiller-manager","namespace":"marketplace-i...
PolicyRule:
  Resources                          Non-Resource URLs  Resource Names  Verbs
  ---------                          -----------------  --------------  -----
  *                                  []                 []              [*]
  *.apps                             []                 []              [*]
  *.authorization.k8s.io             []                 []              [*]
  *.extensions                       []                 []              [*]
  *.rbac.authorization.k8s.io        []                 []              [*]
  *.roles.rbac.authorization.k8s.io  []                 []              [*]

老实说，我不完全理解错误消息以检查是否ownerrules正常，我试图找出这种似乎与角色描述相关的消息的含义：{[*] [*] [*] [] []}

关于我缺少什么权限的任何线索？

Answer 1

这是由于 RBAC 中的权限升级预防。有关详细信息，请参阅https://kubernetes.io/docs/reference/access-authn-authz/rbac/#privilege-escalation-prevention-and-bootstrapping。

创建角色对象的权限是必要的，但还不够。

如果至少满足以下任一条件，则用户只能创建/更新角色：

1. 他们已经拥有角色中包含的所有权限，与被修改的对象处于相同的范围（对于 ClusterRole 来说是集群范围的，在同一个命名空间内，或者对于角色来说是集群范围内的）。在您的情况下，这意味着尝试创建角色的用户必须已经apiGroups=*, resources=*, verbs=*在尝试创建角色的命名空间内拥有权限。您可以通过使用角色绑定将 cluster-admin clusterrole 授予该命名空间内的 serviceaccount 来授予此权限。

2. 他们被授予对 rbac.authorization.k8s.io API 组（Kubernetes 1.12 及更新版本）中的角色或集群角色资源执行“升级”动词的明确权限