# Kubernetes environment

**URL:** <https://forums.suse.com/t/kubernetes-environment/3860>\
**Category:** Rancher 1.x\
**Created:** [August 31, 2016, 2:53pm UTC](https://forums.suse.com/t/kubernetes-environment/3860 "2016-08-31T14:53:57Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yann\_David](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/yann_david/32/1652_2.png) [@Yann\_David](https://forums.suse.com/u/Yann_David)\
**Post date:** [August 31, 2016, 2:53pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/1 "2016-08-31T14:53:57Z")

</div>

I have been playing with rancher for the past week and now I’m hitting those 2 problems…

I have a 3 host ha-rancher setup (no issue there I was even able to update it from 1.1.3 1.2.0-pre2 to check if the issue happened there too) with a Kubernetes environment with 3 hosts.

- When ever I lose a Kubernetes host, when it reconnects OR I add a replacement etcd just never start on that new node.
- Adding a new kubernetes host afterwards, I needed to restart the kubernetes stack for etcd to start (from 1 host to 3 hosts)

any idea why?

---

<div class="post-metadata">

**Author:** ![denise](https://avatars.discourse-cdn.com/v4/letter/d/82dd89/32.png) [@denise](https://forums.suse.com/u/denise)\
**Post date:** [August 31, 2016, 6:05pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/2 "2016-08-31T18:05:18Z")

</div>

Can you share what version of etcd your kubernetes stack is running?

---

<div class="post-metadata">

**Author:** ![Yann\_David](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/yann_david/32/1652_2.png) [@Yann\_David](https://forums.suse.com/u/Yann_David)\
**Post date:** [August 31, 2016, 7:49pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/3 "2016-08-31T19:49:40Z")

</div>

I ended up doing LOTS of stuff and it worked…

Only thing left is that the third etcd still shows as WARNING in Hosts UI but the container is healthy and well behaving.

I’m pretty sure it’s related to the UDP ports required but I’ll have to dig more! If you don’t mind I’ll leave this post open a couple of days to post my findings, they might help more people in my situation.

---

<div class="post-metadata">

**Author:** ![Yann\_David](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/yann_david/32/1652_2.png) [@Yann\_David](https://forums.suse.com/u/Yann_David)\
**Post date:** [August 31, 2016, 11:50pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/4 "2016-08-31T23:50:31Z")

</div>

So I started to realize that my hosts were joining with their Public IPs instead of their private one (No idea how rancher agent actually interpolate it) so I change my bootstrap logic to include `-e CATTLE_AGENT_IP=${PRIVATE_IP}` and now everything works flawlessly so far!

For some reasons AWS Security Groups are not applied to external traffic (at least the from Security-Group feature). Which was my issue, I found it by allowing all from 0.0.0.0/0 instead of from my kubehost security group.

I’ll make some more testing and let you know if it works as expected.

---

<div class="post-metadata">

**Author:** ![LLParse](https://avatars.discourse-cdn.com/v4/letter/l/d9b06d/32.png) [@LLParse](https://forums.suse.com/u/LLParse)\
**Post date:** [September 6, 2016, 5:23pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/5 "2016-09-06T17:23:54Z")

</div>

@Yann_David, would you mind filing an [issue](https://github.com/rancher/rancher/issues/new) for the bug you observed regarding ip traffic routing over Public IPs? We get a lot of complaints about this, but some extra context would be helpful.

Thanks

---

<div class="post-metadata">

**Author:** ![Yann\_David](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/yann_david/32/1652_2.png) [@Yann\_David](https://forums.suse.com/u/Yann_David)\
**Post date:** [September 6, 2016, 5:35pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/6 "2016-09-06T17:35:17Z")

</div>

Sure. Once I got something running on the setup I will… Still unable to expose RC/Pods to the outside world 😕

---

<div class="post-metadata">

**Author:** ![Yann\_David](https://sea2.discourse-cdn.com/flex022/user_avatar/forums.suse.com/yann_david/32/1652_2.png) [@Yann\_David](https://forums.suse.com/u/Yann_David)\
**Post date:** [September 6, 2016, 11:19pm UTC](https://forums.suse.com/t/kubernetes-environment/3860/7 "2016-09-06T23:19:23Z")

</div>

Github issue: [https://github.com/rancher/rancher/issues/5909](https://github.com/rancher/rancher/issues/5909)
