Re: 0.7 -> 0.8 Protocol Upgrade in production environments

2014-01-21 Thread Jason Rosenberg
In my case, we just rolled out a separate 0.8 cluster, and migrated producers to it over time (took several weeks to get everything updated to the new cluster). In the transition, we had consumers running for both clusters. Once no traffic was flowing on the old cluster, we then shut down the 0.7

Re: 0.7 -> 0.8 Protocol Upgrade in production environments

2014-01-21 Thread François Langelier
Hi, I'm also in the process to upgrade from 0.7 to 0.8. WIth the informations I found, your best friend is here : https://cwiki.apache.org/confluence/display/KAFKA/Migrating+from+0.7+to+0.8 It's a migration tool from 0.7 to 0.8. You will have to install 0.8 while you still have you 0.7 running. W

0.7 -> 0.8 Protocol Upgrade in production environments

2014-01-21 Thread Clark Breyman
I'm curious what the recommended best practice is for migrating a production environment with replication from 0.7 to 0.8 given the protocol upgrade. Some specific questions I have are: a) Is it possible to mix 0.7 and 0.8 servers for a given partition during the migration? b) If we can't mix ser