Shantanu,
If session timeout is 10 minutes, it would mean that Kafka will not notice
that a previous consumer has died until 10 minutes has elapsed. So if you
kill a consumer and start a new one, it will not start processing for 10
minutes!
I would not change session timeout from the default. Red
Hi Kaustubh,
We added some fixes after version 0.11.x to improve task assignment
balance. Can you try with Kafka streams version 2.0 and see if things
improve at all?
Kafka Streams version 2.0 is compatible with 0.10.2 broker as long as you
don't enable exactly-once processing, which is turned o
+1 for this. The only small suggestion would be to possibly call this
RondRobinPartitioner which makes the intent obvious.
On Thu, Aug 30, 2018 at 5:31 PM Stephen Powis wrote:
> Neat, this would be super helpful! I submitted this ages ago:
> https://issues.apache.org/jira/browse/KAFKA-
>
> O
Is using /opt/confluent-4.1.1/bin/kafka-run-class kafka.tools.DumpLogSegments
kafka.tools.DumpLogSegments –files --print-data-log, correct way
to verify that the kafka logs are compressed, if using compression.type=snappy?
I have set my compression.type: snappy in my property file for kafka str
Hi Bill,
Thanks for the reply.
Kafka streams we are using 0.11.0.2, but we were able to see the issue in
0.10.2 also. Broker is 0.10.2. Regarding logs, can you please be specific
what you are looking for? Cause log sizes are pretty big, so I can copy and
send relevant portions here.
Thanks
Kaustub
Hello,
I am doing some high-level analysis on the service offerings which we want
to adopt. Currently, confluent comes up as the most popular provider of
apache kafka both on bare metal and as-a-service on public cloud (AWS, GCP,
etc.).
That said, I am interested to know the user experience for K
Hi,
What version of Kafka Streams are you using? Can you share some log files
preferably at the DEBUG level?
Thanks,
Bill
On Thu, Aug 30, 2018 at 9:58 PM kaustubh khasnis
wrote:
> Hi,
> I have written a streams application to talk to topic on cluster of 5
> brokers with 10 partitions. I h
Yes I’m more than happy to change it to a more appropriate name.
The issue with RoundRobinPatitoner is that the DefaultPartitioner already
has a Round-Robin associated to it. But if community doesn’t mind the name,
I don’t either.
Thanks for reading the KIP btw.
Regards,
On Fri, 31 Aug 2018 at
I added the config “auto.offset.reset” = “earliest” to the consumer and it
receives the messages. So I need to cleanup any persistent data after I do
KafkaServer.shutdown()? How do I do that?
On 31/08/2018, 11:30, "Cristian Petroaca" wrote:
Some more weird things:
1. I readded the auto
Shameless plug for an article I wrote on understanding Kafka listeners
better, which might help in this case:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
On Thu, 30 Aug 2018 at 14:14, Andrew Otto wrote:
> The trouble is that the producer and consumer clients need to discover the
>
Some more weird things:
1. I readded the auto.create.topics.enable=true but now I added the
default.replication.factor=1 and now I did not get the error anymore and
consumer is polling. But then when I removed “default.replication.factor” the
consumer still worked without seeing the group coordi
Poll timeout is 1000 ms.
On 30/08/2018, 18:28, "M. Manna" wrote:
What is your poll time for consumers poll() method?
On Thu, 30 Aug 2018, 16:23 Cristian Petroaca,
wrote:
> Ok, so I mixed things up a little.
> I started with the kafka Server being configur
12 matches
Mail list logo
