Could you try the latest code in the 0.8 branch? It fixed one consumer bug
that could cause the issue you saw.
Thanks,
Jun
On Thu, Jun 20, 2013 at 8:29 AM, Yu, Libo wrote:
> Sorry for my late reply. I used to watch the mailing list with Grokbase.
> It somehow stops to update the mailing list
Actually, space is determined by # of total partitions in a
broker, independent of # consumers.
Thanks,
Jun
On Thu, Jun 20, 2013 at 8:22 AM, Yu, Libo wrote:
> Thanks for your answer, Jun. That explains what I found.
> I thought it was for the machine. If there are many
> consumers (as in our
I have been using ZK 3.4.5 in production for about 6 months now with out
any issues, Kafka, HBase, HDFS HA, our own apps all seem to work fine with
it. It also has some nice operational upgrades including auto expiring of
the log and snapshots.
On Tue, Jun 18, 2013 at 8:56 AM, Jun Rao wrote:
>
yeah, that would work!
On Thu, Jun 20, 2013 at 1:20 PM, Jay Kreps wrote:
> Yeah we didn't go as far as adding weighting or anything like that--I
> think we'd be open to a patch that did that as long as it was
> optional. In the short term you can obviously add multiple directories
> on the same
I am interested in discussing a use case, but I probably don't have enough
materials for a presentation. I can describe the use case details and have
a couple high level architecture diagrams of proposed solutions if that is
sufficient.
Thanks,
Jonathan
On Thu, Jun 20, 2013 at 10:16 AM, Jun Ra
I think, if kafka can not identify hostname by its own, try to set the hostname
in the server.properties.
Would this work for you?
--
Markus Roder
Am 20.06.2013 um 17:56 schrieb "Yu, Libo " :
> Hi,
>
> I set up kafka on a linux vm player. There is no hostname with it.
> So I used IP in all con
Yeah we didn't go as far as adding weighting or anything like that--I
think we'd be open to a patch that did that as long as it was
optional. In the short term you can obviously add multiple directories
on the same disk to increase its share.
-Jay
On Thu, Jun 20, 2013 at 12:59 PM, Jason Rosenberg
This sounds like a great idea, to just disks as "just a bunch of disks" or
JBOD.hdfs works well this way.
Do all the disks need to be the same size, to use them evenly? Since it
will allocate partitions randomly?
It would be nice if you had 2 disks, with one twice as large as the other,
if t
The intention is to allow the use of multiple disks without RAID or
logical volume management. We have found that there are a lot of
downsides to RAID--in particular a huge throughput hit. Since we
already have a parallelism model due to partitioning and a fault
tolerance model with replication RAI
Are you just killing Kafka, or Zookeeper too?
On Jun 20, 2013, at 8:59 AM, "Yu, Libo " wrote:
> Hi,
>
> I have kafka running on a three host cluster. I have a
> script that can automatically start zookeepers on all
> three hosts and then start kafka servers on them. It
> can also kill those pro
Good morning Jun. I am interested as well. Please post details how to
signup for this meetup.
On Thu, Jun 20, 2013 at 7:59 AM, Jun Rao wrote:
> Because of the limited venue in the conference hotel, we decided to host
> our user group meeting at LinkedIn in MountainView Thursday (Jun. 27)
> even
If anyone is interested in presenting their use case at our user group
meeting, please let use know. We can add it to the agenda.
Thanks,
Jun
On Thu, Jun 20, 2013 at 8:07 AM, Jonathan Hodges wrote:
> Definitely interested!
>
> Thanks so much for putting this together!
>
>
> On Thu, Jun 20, 20
Hi,
I have kafka running on a three host cluster. I have a
script that can automatically start zookeepers on all
three hosts and then start kafka servers on them. It
can also kill those processes automatically. My question
is after I kill all processes, can I restart right away?
Is there any time
Hi,
I set up kafka on a linux vm player. There is no hostname with it.
So I used IP in all configuration files. I assume that should work.
But I got an exception and kafka asked for hostname. That seems
to be a bug.
Regards,
Libo
Sorry for my late reply. I used to watch the mailing list with Grokbase.
It somehow stops to update the mailing list and I thought you guys
were too busy to reply to us:)
In my case, I have 6 topics ech with 6 partitions. The total data volume
is about 20G.
For my question 1), is it expected to ha
Thanks for your answer, Jun. That explains what I found.
I thought it was for the machine. If there are many
consumers (as in our case), that number is determined
by the most productive consumer. I would prefer a limit
for the machine.
Regards,
Libo
From: Yu, Libo [ICG-IT]
Sent: Monday, June 10,
Definitely interested!
Thanks so much for putting this together!
On Thu, Jun 20, 2013 at 8:59 AM, Jun Rao wrote:
> Because of the limited venue in the conference hotel, we decided to host
> our user group meeting at LinkedIn in MountainView Thursday (Jun. 27)
> evening. We will post the detail
If you want to use the StringEncoder, you should instantiate the producer
as Producer.
Thanks,
Jun
On Thu, Jun 20, 2013 at 3:37 AM, Yulia Stolin wrote:
> Hi,
>
> I'm trying to write some simple producer to that writes messages to kafka
> I've downloaded kafka0.7
>
> Run the kafka server, prod
Before that log entry, you should see why the send fails in WARN. Could you
post that? Also, any error/exception in the broker log (including
state-change log)?
Thanks,
Jun
On Thu, Jun 20, 2013 at 12:08 AM, Ran RanUser wrote:
> I'm stumped:
>
> My sample Producer code does not work in Windows
Because of the limited venue in the conference hotel, we decided to host
our user group meeting at LinkedIn in MountainView Thursday (Jun. 27)
evening. We will post the details of the meetup later this week. We plan to
give an overview of Kafka 0.8. We will also try to invite our SRE at
LinkedIn to
No, our replica assignment logic won't allow that during topic creation.
Thanks,
Jun
On Wed, Jun 19, 2013 at 11:01 PM, Jason Rosenberg wrote:
> is it possible for a partition to have multiple replicas on different
> directories on the same broker? (hopefully no!)
>
>
> On Wed, Jun 19, 2013 a
Hi,
I'm trying to write some simple producer to that writes messages to kafka
I've downloaded kafka0.7
Run the kafka server, producer and consumer
Ø bin/kafka-server-start.sh config/server.properties
Ø bin/kafka-console-consumer.sh --zookeeper zooserver:2181 --topic test
--from-beginning
Ø
Hi,
I'm trying to write some simple producer to that writes messages to kafka
I've downloaded kafka0.7
Run the kafka server, producer and consumer
Ø bin/kafka-server-start.sh config/server.properties
Ø bin/kafka-console-consumer.sh --zookeeper zooserver:2181 --topic test
--from-beginning
Ø
I had similar problem with my setup. It may be different for you but in my
case the producer could not resolve the broker host as registered in
zookeeper. You make a request to the address specified in brokers list,
which successfully returns the topic metadata but the broker might have
registered
Hi Neha,
Any update on the Thursday evening meeting venue?
Thanks,
Jonathan
On Tue, May 28, 2013 at 6:29 PM, Neha Narkhede wrote:
> Vaibhav,
>
> You can plan to be here on Thursday evening. We are still working with
> Hortonworks to see if we can host the meetup at Hadoop Summit venue on
> Th
I'm stumped:
My sample Producer code does not work in Windows, but does work in Linux
(Ubunuty).
My sample Consumer code is fine.
- Kaka 0.8 (June 19), compiled using Scala 2.9.2
- Java version is JDK 1.7x (Oracle version in Windows, OpenJDK on Ubuntu)
- 1 broker, 1 partition,1 replica, no compr
26 matches
Mail list logo
