Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-11-06 Thread Tomas Nunez
Thanks to this last hint we finally got it to work! One problem was that the new kafka 0.8 cluster, was compiled with scala 2.10, while the old 0.7 one was compiled with scala 2.8. As the MigrationTool uses 0.8 binaries, but also libraries from 0.7, there was a mismatch and it wasn't finding the c

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-11-05 Thread Gwen Shapira
Also, can you post your configs? Especially the "zookeeper.connect" one? On Wed, Nov 5, 2014 at 6:15 PM, Gwen Shapira wrote: > Regarding more information: > Maybe ltrace? > > If I were you, I'd go to MigrationTool code and start adding LOG lines. > because there aren't enough of those to trouble

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-11-05 Thread Gwen Shapira
Regarding more information: Maybe ltrace? If I were you, I'd go to MigrationTool code and start adding LOG lines. because there aren't enough of those to troubleshoot. On Wed, Nov 5, 2014 at 6:13 PM, Gwen Shapira wrote: > org.apache.zookeeper.ClientCnxn is throwing the exception, so I'm 100% >

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-11-05 Thread Gwen Shapira
org.apache.zookeeper.ClientCnxn is throwing the exception, so I'm 100% sure it eventually found the class. On Wed, Nov 5, 2014 at 5:59 PM, Tomas Nunez wrote: > Ok, still fighting with the migrationTool here... > > That tuple wasn't in the scala-library.jar. It turns out I was using scala > 2.10

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-11-05 Thread Tomas Nunez
Ok, still fighting with the migrationTool here... That tuple wasn't in the scala-library.jar. It turns out I was using scala 2.10 for kafka0.8 and scala 2.8 for kafka0.7, and the jar files were not compatible. So, for the record, it seems that you need both the 0.7 jar files and your 0.8 kafka com

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Gwen Shapira
The file should be your Scala jar. You should have it in your Kafka lib directory. Do a "jar -t" to make sure it actually contains the Tuple class. Gwen On Fri, Oct 31, 2014 at 8:49 PM, Tomas Nunez wrote: > Thanks for pointing the error. I fixed it, but I'm still getting the same > error. The c

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Tomas Nunez
Thanks for pointing the error. I fixed it, but I'm still getting the same error. The content of migrationToolProducer.properties is now: _ metadata.broker.list=kafka_new01:9092,kafka_new02:9092,kafka_new03:9092,kafka_new04:9092,kafka_new05:9092, group.id=migration.prod _ And the error stil

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Gwen Shapira
This is part of Scala, so it should be in the scala-library-...jar On Fri, Oct 31, 2014 at 8:26 PM, Tomas Nunez wrote: > Well... I used strace and I found it was looking for some classes in a > wrong path. I fixed most of them, but there's one that isn't anywhere, > neither the new nor the old

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Gwen Shapira
The producer configuration should list the kafka brokers, not the zookeeper quorum. See here: http://kafka.apache.org/documentation.html#producerconfigs (and send my regards to Alex Gorbachev ;) Gwen On Fri, Oct 31, 2014 at 8:05 PM, Tomas Nunez wrote: > Hi > > I'm trying to upgrade a 0.7 kaf

Re: Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Tomas Nunez
Well... I used strace and I found it was looking for some classes in a wrong path. I fixed most of them, but there's one that isn't anywhere, neither the new nor the old kafka servers: $ strace -o logfile -s 1000 -f kafka/bin/kafka-run-class.sh kafka.tools.KafkaMigrationTool --kafka.07.jar migrati

Error using migrationtool for upgrading 0.7 to 0.8

2014-10-31 Thread Tomas Nunez
Hi I'm trying to upgrade a 0.7 kafka cluster, but I'm getting an error: I created the file migrationToolConsumer.properties with just theinfo to connect to the old cluster: _ zookeeper.connect=zookeeper01:2181,zookeeper02:2181,zookeeper03:2181 group.id=migration.prod __ Then the produce