Hi Nitin,
It sounds like you are missing configuration for the advertised.listeners.
See
https://www.confluent.de/blog/kafka-client-cannot-connect-to-broker-on-aws-on-docker-etc/
for example.
Once the client has initially connected to a broker, it's the DNS/IP
exchanged in metadata that governs h
s no new incoming data. If this
> is the case, remote time will be close to the max wait time, which is
> normal.
>
> I have seen this when my clusters are idle and I am not sending data to
> them
> hope this helps.
>
>
>
> On Wed, Jun 16, 2021 at 6:53 AM Marcus Horsl
I've recently implemented further monitoring of our Kafka cluster to hone
in on where I think we have bottlenecks.
I'm interested in one metric in particular:
*kafka.network:type=RequestMetrics,name=RemoteTimeMs,request={Produce|FetchConsumer|FetchFollower}*
All the docs I've seen accompanying the
Hi all,
Hoping someone can sanity check my logic!
A cluster I'm working on went into production with some topics poorly
configured; ReplicationFactor of 1 mostly being the issue.
To avoid downtime as much as possible, I used the
kafka-reassign-partitions.sh tool to add extra replicas to topic par
Hi All,
I'm in a sub-optimal situation whereby I have some Kafka Streams apps
deployed to production, but the default replication factor set on the
brokers was 1 when they were first deployed.
As such, any state store changelog topics, and re-partition topics
therefore have RF 1 also.
I'm familia
andby replicas will
> lessen the issue?
>
> Standbys can reduce your recovery time, and for your low throughput use
> case may even reduce recovery time to zero. Thus, if the rebalance
> itself happens quickly enough, the issue with out-of-order data may go
> away (o
easing the grace period should not really affect throughput, but
latency.
-Matthias
On 3/10/21 3:37 PM, Marcus Horsley-Rai wrote:
>
> Thanks for your reply Matthias, and really great talks :-)
>
> You’re right that I only have one input topic - though it does have 20
> partiti
isco-2019/whats-the-time-and-why/>
>
> ->
> https://www.confluent.io/resources/kafka-summit-2020/the-flux-capacitor-of-kafka-streams-and-ksqldb/>
>
>
> Hope this helps.>
>
> -Matthias>
>
> On 3/3/21 7:03 AM, Marcus Horsley-Rai wrote:>
> &
Hi All,
Just to give a bit of context; I have an application which is SNMP polling
a network. Each collector agent works on a 1 minute schedule, polling
device(s) and posting results to a Kafka topic.
The time a given collector publishes data can vary within a minute, but it
should never overlap w
