Hi,
But doesn't this check "!appendInfo.offsetsMonotonic" only ensure there are no
gaps
in the given message set. How do we ensure there are no gaps between this
message set
and previous logged offsets.
Thanks,
Manju
-- Forwarded message --
From: Guozhang Wang
Date: 26 Sep 201
This happened again to me this weekend. I've done some sleuthing, and
definitely can see some crazy paging stats when this lock up happens. For
the curious, more info can be found here:
https://bugzilla.wikimedia.org/show_bug.cgi?id=69667. I had tuned
dirty_expire_centisecs from 30 seconds to 10
We're planning a deploy to AWS EC2, and I was hoping to get some advice on
best practices. I've seen the Loggly presentation [1], which has some good
recommendations on instance types and EBS setup. Aside from that, there
seem to be several options in terms of multi-Availability Zone (AZ)
deploymen
Neha,
Do you know the date in Oct when 0.8.2 is going to be out ?.
Thanks,
Balaji
From: Neha Narkhede [mailto:neha.narkh...@gmail.com]
Sent: Thursday, September 25, 2014 1:08 PM
To: Seshadri, Balaji
Cc: users@kafka.apache.org
Subject: Re: BadVersion state in Kafka Logs
We are close to the rele
It is difficult to predict an exact date. Though all the discussions of the
progress and ETA are on the mailing list. You can follow the discussions to
know the details and/or offer to help out on the outstanding issues.
On Mon, Sep 29, 2014 at 3:48 PM, Seshadri, Balaji
wrote:
> Neha,
>
>
>
> Do
Hi, All
We have some old kafka nodes that are still running 0.7.
We disable the replica of topics there. Recently we added some node brokers
to that cluster, I found new nodes won't got written or read even though
it's registered correctly in zookeeper.
I think in this case, it's because all the
Thanks Valentin!
Guozhang
On Sun, Sep 28, 2014 at 3:49 PM, Valentin wrote:
>
> Hi Jun,
>
> ok, I created:
> https://issues.apache.org/jira/browse/KAFKA-1655
>
> Greetings
> Valentin
>
> On Sat, 27 Sep 2014 08:31:01 -0700, Jun Rao wrote:
> > Valentin,
> >
> > That's a good point. We don't have
At line 243:
appendInfo.firstOffset = nextOffset.get
If there is a gap between two message sets, then appendInfo.offsetsMonotonic
will then catch it right?
offsetsMonotonic
On Mon, Sep 29, 2014 at 2:31 AM, Manjunath Shivakumar <
manjunath.shivaku...@betfair.com> wrote:
> Hi,
>
> But doesn't thi
Hi Guangle,
Replication is only introduced in 0.8, with 0.7 there should not have
leader / follower replicas. Could you verify the version of your Kafka
cluster?
Guozhang
On Mon, Sep 29, 2014 at 4:30 PM, Guangle Fan wrote:
> Hi, All
>
> We have some old kafka nodes that are still running 0.7.
Hi Snehalata,
Did you see this log only a few times or it keep spilling in the log file?
Guozhang
On Sun, Sep 28, 2014 at 11:20 PM, Snehalata Nagaje <
snehalata.nag...@harbingergroup.com> wrote:
>
>
> Hi ,
>
>
> I am getting this error in kafka logs
>
> I wrote this conflicted ephemeral node
>
If only Kafka had rack awarenessyou could run 1 cluster and set up the
replicas in different AZs.
https://issues.apache.org/jira/browse/KAFKA-1215
As for your question about ephemeral versus EBS, I presume you are proposing to
use ephemeral *with* replicas, right?
Philip
---
Hi,
I am kinda newbie to kafka, I plan to build a cluster with multiple nodes, and
multiple brokers on each node, I can find tutorials for set multiple brokers
cluster in single node, say
http://www.michael-noll.com/blog/2013/03/13/running-a-multi-broker-apache-kafka-cluster-on-a-single-node/
Al
Guozhang, yes, the version running on there is still 0.7, you are right,
there is no such concept of replicas on it. Is there a way to rebalance
partitions across all brokers when adding new nodes ?
On Mon, Sep 29, 2014 at 6:11 PM, Guozhang Wang wrote:
> Hi Guangle,
>
> Replication is only intro
13 matches
Mail list logo
