Will, the idea is to have a DNS name or VIP which resolves to IP addresses
from one cluster or the other depending on health checks. You can have your
producers load-balanced 50/50 between two clusters, or could have a backup
cluster that is only used when the primary cluster is unreachable, etc.
Hey Ryanne, thanks for the feedback.
Would you mind going into more detail with how that would work?
My understanding is that the Kafka wire protocol isn’t really intended to
be loadbalanced. Or is it more that the load balancer acts as more of a
service discovery point for clients?
I’ve seen in
Will and Garvit, you can use a load balancer with health checks for this
purpose.
Ryanne
On Wed, Aug 28, 2019, 6:09 PM Will Weber wrote:
> Apologies for piggybacking on a thread, figured the discussion was pretty
> relevant to a thought I had kicking around my brain.
>
> In the event of complet
Apologies for piggybacking on a thread, figured the discussion was pretty
relevant to a thought I had kicking around my brain.
In the event of complete failure or sustained loss of connectivity of the
first cluster, could the secondary cluster act as a failover for a given
configuration?
Assuming
Hello,
As of today, the producer is able to talk to only one Kafka cluster.
*bootstrap.servers* is to provide a list of brokers belonging to the same
cluster to ensure at least one is available.
In your case, you have to replicate the data from the first cluster to the
second cluster with mirror
I guess it more about replication, you can push your data in one choosen
cluster and replicate your data to the second one by using mirror maker or
confluent replicator or the new open sourced project by LinkedIn, "Brooklin"
Le lun. 12 août 2019 à 10:19, Garvit Sharma a écrit :
> Thanks, Isroudi
Thanks, Isroudi. But in my usecase there are two separate zookeeper as
well. Let me know how would it handle.
On Mon, Aug 12, 2019 at 1:45 PM lsroudi abdel wrote:
> If it is two cluster it mean you have two zookeeper, I guess you can't do
> that, I f you have one zookeeper it will be ok, in the
If it is two cluster it mean you have two zookeeper, I guess you can't do
that, I f you have one zookeeper it will be ok, in the case you have one
zookeeper it's just an architecture with replica across two data center, I
hope it clear for you
Le lun. 12 août 2019 à 09:22, Garvit Sharma a écrit :
Hi,
I have 2 kafka clusters in different data-centers so can I provide the dns
hostnames of both the clusters separated by comma in *bootstrap.servers*
key in producer config ?
If I provide two different clusters in *bootstrap.servers *then how would
the events get published ?
Would events get pu
