Isn't that what stateful sets are for, giving you a predictable pod name from
which you can derive the ID?
Tim Ward
-Original Message-
From: Srinivas Rapolu
Sent: 15 November 2018 17:42
To: users@kafka.apache.org
Subject: Re: Kafka running on AWS - how to retain broker.id on new instanc
> if we are not using EBS
In that case, what's the point of keeping the broker id? The data will be
lost anyway right?
On Thu, Nov 15, 2018, 11:40 AM Srinivas Rapolu wrote:
> Yes, I understand we need to specify the required broker.id in
> server.properties/meta.properties file in-order to ret
Yes data will be lost when you use instance storage. But keeping the *same*
broker id will allow the new broker instance to easily replicate data from
other brokers, therefore restoring back to the previous fully replicated
state.
Srinivas, do your topics have replicator factor > 1? If yes, data c
Hi,
I have been doing some performance tests with kafka cluster for my project.
I have a question regarding the send call and the 'acks' property of
producer. I observed below numbers with below invocation of send call. This
is a simple fire and forget call.
producer.send(record);
The topic has
Yes, that is the whole point of discussion, replication factor is more than
1. So keeping it in instance storage, we will lose the one copy of data,
but retaining broker-id will auto-replicate the topic/partitions to new
instance as zookeeper has brokerid-topic-partition assignment mapping.
By loo
By looking at the responses: It looks like there is *NO *standard
solution, we will have to come up with some custom/manual script. any
one has any other suggestions?
On Fri, Nov 16, 2018 at 11:18 AM Srinivas Rapolu wrote:
> Yes, that is the whole point of discussion, replication factor is
I you enable acks, it's not fire and forget any longer.
-Matthias
On 11/16/18 1:00 AM, Abhishek Choudhary wrote:
> Hi,
>
> I have been doing some performance tests with kafka cluster for my project.
> I have a question regarding the send call and the 'acks' property of
> producer. I observed bel
Hello Andrey,
Could you provide a bit more information on how you set the bandwidth based
on client id? Sharing some code snippet would even better for me to
understand your encountered issue.
Guozhang
On Fri, Nov 9, 2018 at 7:11 AM Andrey Dyachkov
wrote:
> Hello,
>
> Could you tell me if ther
Hi Jonathan,
Could you create a JIRA with all the current available information uploaded
on the ticket for me to further investigate the issue? This way we will not
lose track of it (email list is not the best venue for potential bug
investigation :).
At the mean time, I will try to compare the s
Hi RK,
You may find this blog post helpful for incorporating Streams with Connect:
https://yokota.blog/2018/04/23/embedding-kafka-connect-in-kafka-streams-ksql/
I've also cc'ed Robert, the author of this blog post if you are interested
in his code and want to learn more.
Guozhang
On Tue, Oct
10 matches
Mail list logo
