rke给etcd打一次性快照失败

如题:有如下错误信息: time="2021-12-29T15:40:45+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:45+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:46+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:46+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:47+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:47+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:48+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:48+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:49+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:49+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:50+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:50+08:00" level=info msg="Container [etcd-snapshot-once] is still running on host [master1]: stderr: [time=\"2021-12-29T07:40:34Z\" level=warning msg=\"Checking member health failed from etcd member\" data=\"master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\" error=\"exit status 1\"\n], stdout: []" time="2021-12-29T15:40:51+08:00" level=info msg="Waiting for [etcd-snapshot-once] container to exit on host [master1]" time="2021-12-29T15:40:51+08:00" level=info msg="Removing container [etcd-snapshot-once] on host [master1], try #1" time="2021-12-29T15:40:51+08:00" level=fatal msg="[etcd] Failed to take one-time snapshot on host [master1], exit code [1]: time=\"2021-12-29T07:40:51Z\" level=fatal msg=\"exit status 1: master1:2379 is unhealthy: failed to connect: context deadline exceeded\\nError: unhealthy cluster\\n\"\n" 端口检查是ok的: [root@master1 tc]# for endpoint in $(docker exec etcd /bin/sh -c "etcdctl member list | cut -d, -f5"); do > echo "Validating connection to ${endpoint}/health" > docker run --net=host -v $(docker inspect kubelet --format '{{ range .Mounts }}{{ if eq .Destination "/etc/kubernetes" }}{{ .Source }}{{ end }}{{ end }}')/ssl:/etc/kubernetes/ssl:ro master1:5000/appropriate/curl -s -w "\n" --cacert $(docker exec etcd printenv ETCDCTL_CACERT) --cert $(docker exec etcd printenv ETCDCTL_CERT) --key $(docker exec etcd printenv ETCDCTL_KEY) "${endpoint}/health" > done Validating connection to https://master2:2379/health {"health":"true"} Validating connection to https://master3:2379/health {"health":"true"} Validating connection to https://master1:2379/health {"health":"true"} [root@master1 tc]# for endpoint in $(docker exec etcd /bin/sh -c "etcdctl member list | cut -d, -f4"); do > echo "Validating connection to ${endpoint}/version"; > docker run --net=host -v $(docker inspect kubelet --format '{{ range .Mounts }}{{ if eq .Destination "/etc/kubernetes" }}{{ .Source }}{{ end }}{{ end }}')/ssl:/etc/kubernetes/ssl:ro master1:5000/appropriate/curl --http1.1 -s -w "\n" --cacert $(docker exec etcd printenv ETCDCTL_CACERT) --cert $(docker exec etcd printenv ETCDCTL_CERT) --key $(docker exec etcd printenv ETCDCTL_KEY) "${endpoint}/version" > done Validating connection to https://master2:2380/version {"etcdserver":"3.4.15","etcdcluster":"3.4.0"} Validating connection to https://master3:2380/version {"etcdserver":"3.4.15","etcdcluster":"3.4.0"} Validating connection to https://master1:2380/version {"etcdserver":"3.4.15","etcdcluster":"3.4.0"} [root@master1 backup]# docker exec -e ETCDCTL_ENDPOINTS=https://master1:2379 etcd etcdctl snapshot save xiajuming {"level":"info","ts":1640765363.6301417,"caller":"snapshot/v3_snapshot.go:119","msg":"created temporary db file","path":"xiajuming.part"} {"level":"info","ts":"2021-12-29T08:09:23.648Z","caller":"clientv3/maintenance.go:200","msg":"opened snapshot stream; downloading"} {"level":"info","ts":1640765363.6489992,"caller":"snapshot/v3_snapshot.go:127","msg":"fetching snapshot","endpoint":"https://master1:2379"} {"level":"info","ts":"2021-12-29T08:09:24.025Z","caller":"clientv3/maintenance.go:208","msg":"completed snapshot read; closing"} {"level":"info","ts":1640765364.1114204,"caller":"snapshot/v3_snapshot.go:142","msg":"fetched snapshot","endpoint":"https://master1:2379","size":"21 MB","took":0.480903283} {"level":"info","ts":1640765364.1217988,"caller":"snapshot/v3_snapshot.go:152","msg":"saved","path":"xiajuming"} Snapshot saved at xiajuming
已邀请:

要回复问题请先登录注册