无法从 Postman 的 k8s-Skaffold 中的 Express API 获取响应

Question

尝试做一些应该非常简单的事情：启动一个 Express pod 并获取localhost:5000/应该以Hello World!.

• 我已经安装了ingress-nginxDocker for Mac和minikube
  • 强制的：kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/master/deploy/static/mandatory.yaml
  • Mac 版 Docker：kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/master/deploy/static/provider/cloud-generic.yaml
  • 迷你库贝：minikube addons enable ingress
• 我跑skaffold dev --tail
• 它打印出来Example app listening on port 5000，所以显然正在运行
• 导航至localhost和localhost:5000并收到“无法获得任何响应”错误
• 另外，尝试minikube ip过192.168.99.100并体验到相同的结果

不太确定我在这里做错了什么。代码和配置如下。建议？

---

索引.js

// Import dependencies
const express = require('express');

// Set the ExpressJS application
const app = express();

// Set the listening port
// Web front-end is running on port 3000
const port = 5000;

// Set root route
app.get('/', (req, res) => res.send('Hello World!'));

// Listen on the port
app.listen(port, () => console.log(`Example app listening on port ${port}`));

---

skaffold.yaml

apiVersion: skaffold/v1beta15
kind: Config
build:
  local:
    push: false
  artifacts:
    - image: sockpuppet/server
      context: server
      docker:
        dockerfile: Dockerfile.dev
      sync:
        manual:
        - src: '**/*.js'
          dest: .
deploy:
  kubectl:
    manifests:
      - k8s/ingress-service.yaml
      - k8s/server-deployment.yaml
      - k8s/server-cluster-ip-service.yaml

---

入口服务.yaml

apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: ingress-service
  annotations:
    kubernetes.io/ingress.class: nginx
    nginx.ingress.kubernetes.io/rewrite-target: /$1
spec:
  rules:
    - http:
        paths:
          - path: /?(.*)
            backend:
              serviceName: server-cluster-ip-service
              servicePort: 5000

---

服务器部署.yaml

apiVersion: apps/v1
kind: Deployment
metadata:
  name: server-deployment
spec:
  replicas: 3
  selector:
    matchLabels:
      component: server
  template:
    metadata:
      labels:
        component: server
    spec:
      containers:
        - name: server
          image: sockpuppet/server
          ports:
            - containerPort: 5000

---

服务器集群 IP 服务.yaml

apiVersion: v1
kind: Service
metadata:
  name: server-cluster-ip-service
spec:
  type: ClusterIP
  selector:
    component: server
  ports:
    - port: 5000
      targetPort: 5000

---

Dockerfile.dev

FROM node:12.10-alpine
EXPOSE 5000

WORKDIR "/app"
COPY ./package.json ./
RUN npm install
COPY . .

CMD ["npm", "run", "dev"]

---

输出来自describe

$ kubectl describe ingress ingress-service     
Name:             ingress-service
Namespace:        default
Address:          
Default backend:  default-http-backend:80 (<none>)
Rules:
  Host       Path  Backends
  ----       ----  --------
  localhost  
             /   server-cluster-ip-service:5000 (172.17.0.7:5000,172.17.0.8:5000,172.17.0.9:5000)
Annotations:
  kubectl.kubernetes.io/last-applied-configuration:  {"apiVersion":"extensions/v1beta1","kind":"Ingress","metadata":{"annotations":{"kubernetes.io/ingress.class":"nginx"},"name":"ingress-service","namespace":"default"},"spec":{"rules":[{"host":"localhost","http":{"paths":[{"backend":{"serviceName":"server-cluster-ip-service","servicePort":5000},"path":"/"}]}}]}}

  kubernetes.io/ingress.class:  nginx
Events:
  Type    Reason  Age   From                      Message
  ----    ------  ----  ----                      -------
  Normal  CREATE  16h   nginx-ingress-controller  Ingress default/ingress-service
  Normal  CREATE  21s   nginx-ingress-controller  Ingress default/ingress-service

---

输出来自kubectl get po -l component=server

$ kubectl get po -l component=server
NAME                                READY   STATUS    RESTARTS   AGE
server-deployment-cf6dd5744-2rnh9   1/1     Running   0          11s
server-deployment-cf6dd5744-j9qvn   1/1     Running   0          11s
server-deployment-cf6dd5744-nz4nj   1/1     Running   0          11s

输出kubectl describe pods server-deployment：注意到Host Port: 0/TCP. 可能是问题？

Name:               server-deployment-6b78885779-zttns
Namespace:          default
Priority:           0
PriorityClassName:  <none>
Node:               minikube/10.0.2.15
Start Time:         Tue, 08 Oct 2019 19:54:03 -0700
Labels:             app.kubernetes.io/managed-by=skaffold-v0.39.0
                    component=server
                    pod-template-hash=6b78885779
                    skaffold.dev/builder=local
                    skaffold.dev/cleanup=true
                    skaffold.dev/deployer=kubectl
                    skaffold.dev/docker-api-version=1.39
                    skaffold.dev/run-id=c545df44-a37d-4746-822d-392f42817108
                    skaffold.dev/tag-policy=git-commit
                    skaffold.dev/tail=true
Annotations:        <none>
Status:             Running
IP:                 172.17.0.5
Controlled By:      ReplicaSet/server-deployment-6b78885779
Containers:
  server:
    Container ID:   docker://2d0aba8f5f9c51a81f01acc767e863b7321658f0a3d0839745adb99eb0e3907a
    Image:          sockpuppet/server:668dfe550d93a0ae76eb07e0bab900f3968a7776f4f177c97f61b18a8b1677a7
    Image ID:       docker://sha256:668dfe550d93a0ae76eb07e0bab900f3968a7776f4f177c97f61b18a8b1677a7
    Port:           5000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Tue, 08 Oct 2019 19:54:05 -0700
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-qz5kr (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             True
  ContainersReady   True
  PodScheduled      True
Volumes:
  default-token-qz5kr:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-qz5kr
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type    Reason     Age        From               Message
  ----    ------     ----       ----               -------
  Normal  Scheduled  <unknown>  default-scheduler  Successfully assigned default/server-deployment-6b78885779-zttns to minikube
  Normal  Pulled     7s         kubelet, minikube  Container image "sockpuppet/server:668dfe550d93a0ae76eb07e0bab900f3968a7776f4f177c97f61b18a8b1677a7" already present on machine
  Normal  Created    7s         kubelet, minikube  Created container server
  Normal  Started    6s         kubelet, minikube  Started container server

Answer 1

好的，现在已经解决了。

\n\n

它归结为所使用的服务类型：ClusterIP。

\n\n

\n

ClusterIP：在集群内部 IP 上公开服务。选择此值使得服务只能从集群内部访问。这是默认的服务类型。

\n

\n\n

如果我想直接从集群外部连接到 Pod 或部署（例如 Postman、pgAdmin 等）并且我想使用服务来完成此操作，我应该使用NodePort：

\n\n

\n

NodePort：在静态端口（NodePort）上公开每个 Node\xe2\x80\x99s IP 上的服务。NodePort 服务将路由到的 ClusterIP 服务会自动创建。您\xe2\x80\x99将能够通过请求<NodeIP>：从集群外部联系NodePort服务<NodePort>。

\n

\n\n

因此，就我而言，如果我想继续使用服务，我会将服务清单更改为：

\n\n

apiVersion: v1\nkind: Service\nmetadata:\n  name: server-cluster-ip-service\nspec:\n  type: NodePort\n  selector:\n    component: server\n  ports:\n    - port: 5000\n      targetPort: 5000\n      nodePort: 31515\n

\n\n

确保手动设置nodePort: <port>，否则它是随机的并且使用起来很痛苦。

\n\n

然后我会获取minikubeIP 并minikube ip使用 来连接到 Pod 192.168.99.100:31515。

\n\n

那时，一切都按预期进行。

\n\n

但这意味着拥有不同的开发 ( NodePort) 和生产 ( ClusterIP) 清单集，这可能完全没问题。但我希望我的清单尽可能接近生产版本（即ClusterIP）。

\n\n

有几种方法可以解决这个问题：

\n\n

\n
1. 使用像Kustomize这样的东西，你可以设置一个 base.yaml，然后为每个环境进行覆盖，它只是更改相关信息，避免大部分重复的清单。
\n

2. 使用kubectl port-forward。我想这就是我要走的路。这样我就可以保留一组生产清单，但是当我想使用 pgAdmin 对 Postgres 进行 QA 时，我可以这样做：

   \n\n

   kubectl port-forward services/postgres-cluster-ip-service 5432:5432

   \n\n

   或者对于后端和 Postman：

   \n\n

   kubectl port-forward services/server-cluster-ip-service 5000:5000

\n

\n\n

我正在尝试通过ingress-service.yamlusing来做到这一点nginx-ingress，但还没有完全发挥作用。当我这样做时会更新。但对我来说，port-forward这似乎是可行的方法，因为我只需拥有一组无需更改的生产清单。

\n\n

Skaffold 端口转发

\n\n

这更适合我的需求。将其附加到 and 的底部基本上与不绑定一个或两个终端skaffold.yaml是一样的：kubectl port-forward

\n\n

portForward:\n  - resourceType: service\n    resourceName: server-cluster-ip-service\n    port: 5000\n    localPort: 5000\n  - resourceType: service\n    resourceName: postgres-cluster-ip-service\n    port: 5432\n    localPort: 5432\n

\n\n

然后跑skaffold dev --port-forward。

\n