Re: Any suggestion about Kafka/Zookeeper migration.

2018-01-04 Thread Tim Visher
On Thu, Jan 4, 2018 at 11:55 AM, Tony Liu wrote: > Thanks Timmy. > > I appreciate your suggestion, but for us, it's hard to do that , the > problem are : > >- 6+ Kafka cluster. >- more than 200 micro services or applications are talking with Kafka >now. > > Any other suggestion for ou

Re: Any suggestion about Kafka/Zookeeper migration.

2018-01-04 Thread Tony Liu
Thanks Timmy. I appreciate your suggestion, but for us, it's hard to do that , the problem are : - 6+ Kafka cluster. - more than 200 micro services or applications are talking with Kafka now. Any other suggestion for our case ? On Thu, Jan 4, 2018 at 6:06 AM, Tim Visher wrote: > On

Re: Any suggestion about Kafka/Zookeeper migration.

2018-01-04 Thread Tim Visher
On Wed, Jan 3, 2018 at 11:39 PM, Tony Liu wrote: > This post here is aimed to ask experience about what did you do migration > `Kafka/zookeeper` ? :) > > I think the easiest way to migrate kafka is to do a blue/green deploy. Stand up an entire new cluster, cut over producers to it, wait for the

Re: Any suggestion about Kafka/Zookeeper migration.

2018-01-03 Thread Tony Liu
for solution A , actually including two parts: - zookeeper : manual operation to migrate zookeeper, so far I think it needs at least 6 steps. this part will be tricky, we will have 3 zookeeper exhibitor , and 5 new zookeeper without e - Kafka : this should be easier , try launch new on

Re: Any suggestion about Kafka/Zookeeper migration.

2018-01-03 Thread Ted Yu
Did you intend to attach pictures following the two solutions ? It seems the pictures didn't come thru. FYI On Wed, Jan 3, 2018 at 8:39 PM, Tony Liu wrote: > Hi All, > > This post here is aimed to ask experience about what did you do migration > `Kafka/zookeeper` ? :) > > All of Kafka/zookeep

Any suggestion about Kafka/Zookeeper migration.

2018-01-03 Thread Tony Liu
Hi All, This post here is aimed to ask experience about what did you do migration `Kafka/zookeeper` ? :) All of Kafka/zookeeper are running on AWS, because of some reason, we have to replace all the existed server (you can simply think we will terminate the old server and create new server to re