# Unable to create RKE cluster **URL:** \ **Category:** SUSE Rancher Prime\ **Created:** [June 12, 2020, 9:35pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711 "2020-06-12T21:35:55Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![dbrancher](https://avatars.discourse-cdn.com/v4/letter/d/f4b2a3/32.png) [@dbrancher](https://forums.suse.com/u/dbrancher)\ **Post date:** [June 12, 2020, 9:35pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/1 "2020-06-12T21:35:55Z")
Hi Rancher Team. I have three openstack nodes with Centos. These machines dont have public IP address. I have added the user(centos which is the ssh user) to docker group I have the three nodes added to the /etc/hosts so they can communicate. From my windows I can easily ssh into these hosts. Example ssh -i C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem [centos@172.24.173.67](mailto:centos@172.24.173.67) docker ps -a ## The cluster.yml file ## cluster\_name: db-rke-cluster1 ingress: provider: nginx network: plugin: calico nodes: # address: “127.0.0.1” ``` internal_address: "172.24.173.65" port: 2222 role: - controlplane - worker - etcd ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem" user: centos ``` - # address: “127.0.0.1” ``` internal_address: "172.24.173.66" port: 2222 role: - worker ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem" user: centos ``` - # address: “127.0.0.1” ``` internal_address: "172.24.173.67" port: 2222 role: - worker ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem" user: centos ``` services: etcd: creation: 6h retention: 24h snapshot: true When I run the rke up command I get the following error 👎 time=“2020-06-12T12:35:58-07:00” level=info msg=“Running RKE version: v1.1.2” time=“2020-06-12T12:35:58-07:00” level=info msg=“Initiating Kubernetes cluster” time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.67]" time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.66]" time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.65]" time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.65]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker\_engine/v1.24/info: Failed to dial ssh using address [172.24.173.65:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length” time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.67]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker\_engine/v1.24/info: Failed to dial ssh using address [172.24.173.67:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length” time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.66]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker\_engine/v1.24/info: Failed to dial ssh using address [172.24.173.66:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length” time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.65] from node lists” time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.67] from node lists” time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.66] from node lists” time=“2020-06-12T12:35:58-07:00” level=warning msg="[state] can’t fetch legacy cluster state from Kubernetes: Cluster must have at least one etcd plane host: failed to connect to the following etcd host(s) [172.24.173.65]" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating CA kubernetes certificates" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server certificates" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Service account token key" time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kube Controller certificates" time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Scheduler certificates" time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Proxy certificates" time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Node certificate" time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating admin certificates and kubeconfig" time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kubernetes API server proxy client certificates" time=“2020-06-12T12:35:59-07:00” level=info msg=“Successfully Deployed state file at [./cluster.rkestate]” time=“2020-06-12T12:35:59-07:00” level=info msg=“Building Kubernetes cluster” time=“2020-06-12T12:35:59-07:00” level=fatal msg=“Cluster must have at least one etcd plane host: please specify one or more etcd in cluster config” What am I doing wrong??? ---
**Author:** ![superseb](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/superseb/32/2424_2.png) [@superseb](https://forums.suse.com/u/superseb)\ **Post date:** [June 15, 2020, 4:06pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/2 "2020-06-15T16:06:23Z")
Based on Google its because of the encoding of the key file. How was the key created? ---
**Author:** ![dbrancher](https://avatars.discourse-cdn.com/v4/letter/d/f4b2a3/32.png) [@dbrancher](https://forums.suse.com/u/dbrancher)\ **Post date:** [June 15, 2020, 5:49pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/3 "2020-06-15T17:49:14Z")
Hi. Thanks for your reply. The key was created during the time of Openstack VM creation. I regularly use the .ppk version of it to putty into the VMS. I am able to run ssh command from cygwin with the exact key. Do you think the .pem file has some trailing windows characters, clearly RKE cannot parse them??? ---
**Author:** ![superseb](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/superseb/32/2424_2.png) [@superseb](https://forums.suse.com/u/superseb)\ **Post date:** [June 15, 2020, 6:23pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/4 "2020-06-15T18:23:59Z")
Sounds identical to [https://github.com/hashicorp/packer/issues/2526](https://github.com/hashicorp/packer/issues/2526), we can probably use their solution/workaround if it is the case. Can you manually convert a copy of the key (from BER to DER) and try to use that to confirm that is the issue? ---
**Author:** ![dbrancher](https://avatars.discourse-cdn.com/v4/letter/d/f4b2a3/32.png) [@dbrancher](https://forums.suse.com/u/dbrancher)\ **Post date:** [June 15, 2020, 6:42pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/5 "2020-06-15T18:42:15Z")
Hi, Yes will definetely try. There’s a great link explaining the formats [difference in key formats](https://stackoverflow.com/questions/17670446/what-is-the-difference-between-various-keys-in-public-key-encryption#:~:text=PEM%20is%20a%20text%20file,private%20key%20in%20OpenSSH%20format.&text=To%20authenticate%20on%20remote%20server,key%20in%20your%20SSH%20client.) However once I do that, I do have another issue that I am currently facing Now everytime I TRY to run rke remove command or some sort of reset I keep getting time=“2020-06-15T11:39:27-07:00” level=fatal msg="Failed to validate cluster: Cluster can’t have duplicate node: " Once I have corrected the ssh key should I just run the rke up command or do something else to reset. I deleted the state file that got created and when I first ran the rke up command and got ssh error. Again thanks a lot for your help. Will keep you all posted. ---
**Author:** ![superseb](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/superseb/32/2424_2.png) [@superseb](https://forums.suse.com/u/superseb)\ **Post date:** [June 15, 2020, 7:37pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/6 "2020-06-15T19:37:53Z")
You have duplicate `address:` values in your configuration file. If you don’t have explicit address and public addresses for each node, you can just define address alone. ---
**Author:** ![dbrancher](https://avatars.discourse-cdn.com/v4/letter/d/f4b2a3/32.png) [@dbrancher](https://forums.suse.com/u/dbrancher)\ **Post date:** [June 15, 2020, 7:56pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/7 "2020-06-15T19:56:31Z")
I see. so I dont have public address for the nodes. In this case should I just use the address field only and no internal\_address or just address field with the ip\_address of the node. Thank you, ---
**Author:** ![dbrancher](https://avatars.discourse-cdn.com/v4/letter/d/f4b2a3/32.png) [@dbrancher](https://forums.suse.com/u/dbrancher)\ **Post date:** [June 15, 2020, 9:38pm UTC](https://forums.suse.com/t/unable-to-create-rke-cluster/17711/8 "2020-06-15T21:38:30Z")
Got it to work. It was the ssh file, as soon as 1]I converted from .pem file to id\_rsa using puttyGen tool (exporting to openssh) format 2] And used address field only with the ip addresses of the openstack vms, I was able to get the cluster installed successfully. ``` db103475@DB103475-DD /cygdrive/c/RKE $ rke up --config ./cluster1.yml time="2020-06-15T13:14:36-07:00" level=info msg="Running RKE version: v1.1.2" time="2020-06-15T13:14:36-07:00" level=info msg="Initiating Kubernetes cluster" time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]" time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]" time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]" time="2020-06-15T13:14:36-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.65], try #1" time="2020-06-15T13:14:36-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.65], try #1" time="2020-06-15T13:14:42-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:42-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.65], try #1" time="2020-06-15T13:14:42-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.65]" time="2020-06-15T13:14:42-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.66], try #1" time="2020-06-15T13:14:42-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.66], try #1" time="2020-06-15T13:14:47-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:14:47-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.66], try #1" time="2020-06-15T13:14:48-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.66]" time="2020-06-15T13:14:48-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.67], try #1" time="2020-06-15T13:14:48-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.67], try #1" time="2020-06-15T13:14:53-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:14:53-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.67], try #1" time="2020-06-15T13:14:53-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.67]" time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating CA kubernetes certificates" time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kubernetes API server certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Service account token key" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Controller certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Scheduler certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Proxy certificates" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Node certificate" time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating admin certificates and kubeconfig" time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating Kubernetes API server proxy client certificates" time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating kube-etcd-172-24-173-65 certificate and key" time="2020-06-15T13:14:55-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]" time="2020-06-15T13:14:55-07:00" level=info msg="Building Kubernetes cluster" time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]" time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]" time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]" time="2020-06-15T13:14:56-07:00" level=info msg="[network] Deploying port listener containers" time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-etcd-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-etcd-port-listener] container on host [172.24.173.65]" time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-cp-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-cp-port-listener] container on host [172.24.173.65]" time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.67], try #1" time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.66], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.67]" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.66]" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Port listener containers deployed successfully" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> etcd port checks" time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> worker port checks" time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running workers -> control plane port checks" time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.67], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.66], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.67]" time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.67], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.66]" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.66], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="[network] Checking KubeAPI port Control Plane hosts" time="2020-06-15T13:14:58-07:00" level=info msg="[network] Removing port listener containers" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-etcd-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-etcd-port-listener] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-cp-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-cp-port-listener] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.67], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.66], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.67]" time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.66]" time="2020-06-15T13:14:58-07:00" level=info msg="[network] Port listener containers removed successfully" time="2020-06-15T13:14:58-07:00" level=info msg="[certificates] Deploying kubernetes certificates to Cluster nodes" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.66], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.67], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1" time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.67], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.66], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.65], try #1" time="2020-06-15T13:15:03-07:00" level=info msg="[reconcile] Rebuilding and updating local kube config" time="2020-06-15T13:15:03-07:00" level=info msg="Successfully Deployed local admin kubeconfig at [./kube_config_cluster1.yml]" time="2020-06-15T13:15:04-07:00" level=info msg="[certificates] Successfully deployed kubernetes certificates to Cluster nodes" time="2020-06-15T13:15:04-07:00" level=info msg="[file-deploy] Deploying file [/etc/kubernetes/audit-policy.yaml] to node [172.24.173.65]" time="2020-06-15T13:15:04-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:15:04-07:00" level=info msg="Starting container [file-deployer] on host [172.24.173.65], try #1" time="2020-06-15T13:15:05-07:00" level=info msg="Successfully started [file-deployer] container on host [172.24.173.65]" time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:05-07:00" level=info msg="Container [file-deployer] is still running on host [172.24.173.65]" time="2020-06-15T13:15:06-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:06-07:00" level=info msg="Removing container [file-deployer] on host [172.24.173.65], try #1" time="2020-06-15T13:15:06-07:00" level=info msg="[remove/file-deployer] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:15:06-07:00" level=info msg="[/etc/kubernetes/audit-policy.yaml] Successfully deployed audit policy file to Cluster control nodes" time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] Reconciling cluster state" time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] This is newly generated cluster" time="2020-06-15T13:15:06-07:00" level=info msg="Pre-pulling kubernetes images" time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.65], try #1" time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.66], try #1" time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.67], try #1" time="2020-06-15T13:15:54-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]" time="2020-06-15T13:15:55-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]" time="2020-06-15T13:15:56-07:00" level=info msg="Kubernetes images pulled successfully" time="2020-06-15T13:15:56-07:00" level=info msg="[etcd] Building up etcd plane.." time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:15:56-07:00" level=info msg="Starting container [etcd-fix-perm] on host [172.24.173.65], try #1" time="2020-06-15T13:15:57-07:00" level=info msg="Successfully started [etcd-fix-perm] container on host [172.24.173.65]" time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:57-07:00" level=info msg="Container [etcd-fix-perm] is still running on host [172.24.173.65]" time="2020-06-15T13:15:58-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]" time="2020-06-15T13:15:58-07:00" level=info msg="Removing container [etcd-fix-perm] on host [172.24.173.65], try #1" time="2020-06-15T13:15:58-07:00" level=info msg="[remove/etcd-fix-perm] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:15:58-07:00" level=info msg="Pulling image [rancher/coreos-etcd:v3.4.3-rancher1] on host [172.24.173.65], try #1" time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/coreos-etcd:v3.4.3-rancher1] exists on host [172.24.173.65]" time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd] on host [172.24.173.65], try #1" time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd] container on host [172.24.173.65]" time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Running rolling snapshot container [etcd-snapshot-once] on host [172.24.173.65]" time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd-rolling-snapshots] on host [172.24.173.65], try #1" time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd-rolling-snapshots] container on host [172.24.173.65]" time="2020-06-15T13:16:07-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:08-07:00" level=info msg="Starting container [rke-bundle-cert] on host [172.24.173.65], try #1" time="2020-06-15T13:16:08-07:00" level=info msg="[certificates] Successfully started [rke-bundle-cert] container on host [172.24.173.65]" time="2020-06-15T13:16:08-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]" time="2020-06-15T13:16:08-07:00" level=info msg="Container [rke-bundle-cert] is still running on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="[certificates] successfully saved certificate bundle [/opt/rke/etcd-snapshots//pki.bundle.tar.gz] on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-bundle-cert] on host [172.24.173.65], try #1" time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:09-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started etcd plane.. Checking etcd cluster health" time="2020-06-15T13:16:09-07:00" level=info msg="[controlplane] Building up Controller Plane.." time="2020-06-15T13:16:09-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1" time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:16:10-07:00" level=info msg="Starting container [kube-apiserver] on host [172.24.173.65], try #1" time="2020-06-15T13:16:10-07:00" level=info msg="[controlplane] Successfully started [kube-apiserver] container on host [172.24.173.65]" time="2020-06-15T13:16:10-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-apiserver] on host [172.24.173.65]" time="2020-06-15T13:16:18-07:00" level=info msg="[healthcheck] service [kube-apiserver] on host [172.24.173.65] is healthy" time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:18-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:18-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:18-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [kube-controller-manager] on host [172.24.173.65], try #1" time="2020-06-15T13:16:19-07:00" level=info msg="[controlplane] Successfully started [kube-controller-manager] container on host [172.24.173.65]" time="2020-06-15T13:16:19-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-controller-manager] on host [172.24.173.65]" time="2020-06-15T13:16:24-07:00" level=info msg="[healthcheck] service [kube-controller-manager] on host [172.24.173.65] is healthy" time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:24-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:24-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:24-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [kube-scheduler] on host [172.24.173.65], try #1" time="2020-06-15T13:16:25-07:00" level=info msg="[controlplane] Successfully started [kube-scheduler] container on host [172.24.173.65]" time="2020-06-15T13:16:25-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-scheduler] on host [172.24.173.65]" time="2020-06-15T13:16:30-07:00" level=info msg="[healthcheck] service [kube-scheduler] on host [172.24.173.65] is healthy" time="2020-06-15T13:16:30-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:30-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:30-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:30-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started Controller Plane.." time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating rke-job-deployer ServiceAccount" time="2020-06-15T13:16:30-07:00" level=info msg="[authz] rke-job-deployer ServiceAccount created successfully" time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating system:node ClusterRoleBinding" time="2020-06-15T13:16:30-07:00" level=info msg="[authz] system:node ClusterRoleBinding created successfully" time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating kube-apiserver proxy ClusterRole and ClusterRoleBinding" time="2020-06-15T13:16:30-07:00" level=info msg="[authz] kube-apiserver proxy ClusterRole and ClusterRoleBinding created successfully" time="2020-06-15T13:16:31-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]" time="2020-06-15T13:16:31-07:00" level=info msg="[state] Saving full cluster state to Kubernetes" time="2020-06-15T13:16:31-07:00" level=info msg="[state] Successfully Saved full cluster state to Kubernetes ConfigMap: full-cluster-state" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Building up Worker Plane.." time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="[sidekick] Sidekick container already created on host [172.24.173.65]" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.65], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.66], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.65]" time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.65]" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.67], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.66], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.66], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.67], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.66]" time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.67], try #1" time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.67]" time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.67]" time="2020-06-15T13:16:36-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.65] is healthy" time="2020-06-15T13:16:36-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:36-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:36-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:36-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.65], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.66] is healthy" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.67] is healthy" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.65] is healthy" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.66], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.66]" time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.67], try #1" time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.67]" time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.66] is healthy" time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.67] is healthy" time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]" time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]" time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started Worker Plane.." time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]" time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]" time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.66], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.67], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.65], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.67]" time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.66], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.67], try #1" time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.66]" time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.67]" time="2020-06-15T13:16:39-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.65]" time="2020-06-15T13:16:39-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.65], try #1" time="2020-06-15T13:16:39-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.65]" time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Syncing nodes Labels and Taints" time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Successfully synced nodes Labels and Taints" time="2020-06-15T13:16:39-07:00" level=info msg="[network] Setting up network plugin: calico" time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-network-plugin to Kubernetes" time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-network-plugin to Kubernetes" time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Executing deploy job rke-network-plugin" time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Setting up coredns" time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-coredns-addon to Kubernetes" time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-coredns-addon to Kubernetes" time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Executing deploy job rke-coredns-addon" time="2020-06-15T13:16:49-07:00" level=info msg="[addons] CoreDNS deployed successfully" time="2020-06-15T13:16:49-07:00" level=info msg="[dns] DNS provider coredns deployed successfully" time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Setting up Metrics Server" time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-metrics-addon to Kubernetes" time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-metrics-addon to Kubernetes" time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Executing deploy job rke-metrics-addon" time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Metrics Server deployed successfully" time="2020-06-15T13:16:54-07:00" level=info msg="[ingress] Setting up nginx ingress controller" time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-ingress-controller to Kubernetes" time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-ingress-controller to Kubernetes" time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Executing deploy job rke-ingress-controller" time="2020-06-15T13:17:00-07:00" level=info msg="[ingress] ingress controller nginx deployed successfully" time="2020-06-15T13:17:00-07:00" level=info msg="[addons] Setting up user addons" time="2020-06-15T13:17:00-07:00" level=info msg="[addons] no user addons defined" time="2020-06-15T13:17:00-07:00" level=info msg="Finished building Kubernetes cluster successfully" ``` Thank you