kubernetes/k8s接合阿里云LoadBalancer/负载均衡

在生产环境中kubernetes如果仅提供http或https服务,则可以使用nginx-ingress或者traefik之类的七层负载均衡软件。 当然,也可以通过NodePort的方式暴露http或tcp服务。如果不想直接使用NodePort暴露出的那个端口号,而服务器又是运行在阿里云上,那么可以使用阿里云提供的Kubernetes Cloud Controller Manager来对外暴露TCP服务或http/https服务。

前提:

1.在阿里云上购买了几台ecs

2.在阿里云的ecs上搭建好了一个kubernetes集群,这里以kubernetes1.9.0为例

3.在阿里云上购买一个公网的负载均衡

就可以开始配置阿里云的负载均衡与kubernetes整合了。以下是配置步骤:

  1. 先获取每台ecs对应的regionId和ecsId,可以使用命令echo \`curl -s http://100.100.100.200/latest...\`.\`curl -s http://100.100.100.200/latest...\`获取。
  2. 把apiserver, controller-manager和kubelet都添加启动参数 --cloud-provider=external,并且在kubelet中添加--provider-id=上面得到的<REGION\_ID>.<ECS\_ID>
  3. 先创建一个secret用来保存阿里的Access Key Id和Access Key Secret(这两项值在阿里的控制台可以查到),编写一个alicloud-secret.yaml文件,如下

    apiVersion: v1kind: Secretmetadata:  name: alicloud-config  namespace: kube-systemdata:  # insert your base64 encoded AliCloud access id and key here, ensure there's no trailing newline:  # to base64 encode your token run:  #      echo -n "abc123abc123doaccesstoken" | base64  access-key-id: "<ACCESS_KEY_ID>"  access-key-secret: "<ACCESS_KEY_SECRET>"
    

    这里的id和secret就是把从阿里控制台中得到的用base64编码,然后替换到上面文件中就可以了。然后用kubectl apply -f alicloud-secret.yaml创建对应secret.

  4. 接下来再编写alicloud-controller-manager.yaml文件,如下

    apiVersion: extensions/v1beta1kind: Deploymentmetadata:  name: alicloud-controller-manager  namespace: kube-systemspec:  replicas: 1  revisionHistoryLimit: 2  template:    metadata:      labels:        app: alicloud-controller-manager    spec:      dnsPolicy: Default      tolerations:        # this taint is set by all kubelets running `--cloud-provider=external`        - key: "node.cloudprovider.kubernetes.io/uninitialized"          value: "true"          effect: "NoSchedule"      containers:      - image: registry.cn-hangzhou.aliyuncs.com/kube-test/alicloud-controller-manager:v0.1.0        name: alicloud-controller-manager        command:          - /alicloud-controller-manager          # set leader-elect=true if you have more that one replicas          - --leader-elect=false          - --allocate-node-cidrs=true          # set this to what you set to controller-manager or kube-proxy          - --cluster-cidr=10.0.6.0/24          # if you want to use a secure endpoint or deploy in a kubeadm deployed cluster, you need to use a kubeconfig instead.          - --master=10.0.0.10:8080        env:          - name: ACCESS_KEY_ID            valueFrom:              secretKeyRef:                name: alicloud-config                key: access-key-id          - name: ACCESS_KEY_SECRET            valueFrom:              secretKeyRef:                name: alicloud-config                key: access-key-secret
    

    注意上面红字部分,根据自己的配置情况替换。同样,使用kubectl apply -f alicloud-controller-manager.yaml来创建对应的deployment

  5. 然后就可以创建一个service来使用它了,例如我下面创建一个zookeeper的服务

    apiVersion: v1kind: Servicemetadata:  name: zookeeper-master  labels:    app: zookeeper-master  namespace: xxxxxspec:  ports:  - port: 2181    targetPort: 2181    protocol: TCP    name: main-port  selector:    app: zookeeper-master  type: LoadBalancer
    

    这时可以通过kubectl get svc看到对应的service已经有了external-ip

  6. 要在阿里控制台把负载均衡设置一下后端服务器,把k8s的node节点都添加进去。

评论

暂无评论