Hello,
Is there a way to migrate kafka data from server A to another server B?
Can I just copy the data from $log.dir in server.properties and
zookeeper file from $dataDir in zookeeper.properties from server A to
server B, and then run server B's kafka instance?
thanks,
Jason
Hi guys,
Do you know by a chance the status of the project IronCount
(git://github.com/edwardcapriolo/IronCount.git)
Will it be available to work kafka 0.8?
Should I start using? or should look for another project? I see it was
not updated for 10 months
Thanks
Guy Doulberg
Yes, you can. You just need to copy data in log.dir on disk to the new
machine and keep the broker.id in broker config the same. No need to change
anything in ZK since broker will re-register on startup. The main purpose
of broker.id is to allow people to move data logically from 1 broker to
anothe
We don't have such built-in adaptors like Flume yet. They are very useful.
If anyone wants to work on this and contribute back, it would be great for
the community.
If you use log4j, Kafka does have a bult-in log4j appender.
Thanks,
Jun
On Wed, Feb 27, 2013 at 7:57 AM, Vijay Ram wrote:
> Hi A
Vijay,
In Kafka, we have the ConsoleConsumer that tails a topic and streams data
continuously from the logs. You can run it like this -
./bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic foo
Does that help or were you referring to something else ?
Thanks,
Neha
On Wed, Feb 27,
Jason,
Assuming this question is for 0.7, you can just copy the data in the log
directory and restart the new broker. You don't need to copy the zookeeper
data.
Thanks,
Neha
On Feb 27, 2013 2:11 AM, "Jason Huang" wrote:
> Hello,
>
> Is there a way to migrate kafka data from server A to another
Thanks Neha, Let me try as well.
Thanks
Vijay Ram
-Original Message-
From: Neha Narkhede [mailto:neha.narkh...@gmail.com]
Sent: Wednesday, February 27, 2013 12:55 PM
To: users@kafka.apache.org
Subject: Re: Tailing utilty in Kafka
Vijay,
In Kafka, we have the ConsoleConsumer that tails
Jun,
Sure, I will try to create similar and contribute, Let me know if any JIRA
has created.
Thanks and Regards
Vijay
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Wednesday, February 27, 2013 12:51 PM
To: users@kafka.apache.org
Subject: Re: Tailing utilty in Kafka
We
Vijay,
We can create a JIRA but it will help if you can describe how different it
is from ConsoleConsumer. We had intended ConsoleConsumer to be the Kafka
tail utility. It will be great
if we get feedback on how we can improve it.
Thanks,
Neha
On Wed, Feb 27, 2013 at 11:34 AM, Vijay Ram wrote:
Thanks for the response.
I apologize - I should have mentioned that we are trying out kafka 0.8
because of its new exciting features.
So for 0.8, what do I need to do with the zookeeper data? copy
zookeeper file from $dataDir in zookeeper.properties from server A to
server B, and then run server
As Jun described, the purpose of broker.id is to be able to move data from
one broker to the other without changes. I believe this should work in 0.8
as well. However, we've never tried it so not sure if there are bugs. Let
us know how it goes.
Thanks,
Neha
On Wed, Feb 27, 2013 at 1:31 PM, Jason
Just to note moving to Unix you will no longer get this one, but rather the
test suite will run.
On Feb 28, 2013, at 12:38 AM, zayeem wrote:
I fetched the head version(0.8) of Kafka and ran sbt test and got the
following error. This is on a windows machine. Should i be using a
different version
On Unix, the fatal error is not there; Despite some errors, the build/test
runs completes.
Zayeem
On Thu, Feb 28, 2013 at 2:09 AM, Matan Safriel wrote:
> Just to note moving to Unix you will no longer get this one, but rather the
> test suite will run.
>
>
> On Feb 28, 2013, at 12:38 AM, zayee
13 matches
Mail list logo
