We had an issue last week when kafka cluster reported under replicated
partitions for quite a while but there were no brokers down. All the
brokers were reporting unknownException on Broker 1. When checked broker 1
logs, it just reported below errors(NotAssignedReplicaException)
continuously. Issue
To explain what you're seeing: After you have run a consumer application
once, it will have stored its latest consumer offsets in Kafka. Upon
restart -- e.g. after a brief shutdown time as you mentioned -- the
consumer application will continue processing from the point of these
stored consumer o
Another option is to set enable.auto.commit=false and never commit the
offset, it should always go back to latest that way.
On Tue, Jul 12, 2016 at 1:34 PM Michael Noll wrote:
> To explain what you're seeing: After you have run a consumer application
> once, it will have stored its latest consu
When I set compression.type=gzip, it works very well, but snappy not.
At 2016-07-11 22:41:49, "xu" wrote:
Hi All:
I update broker version from 0.8.2 to 0.10.0 and set
"compression.type=snappy" in server.properties. Version of producers and
consumers is still 0.8.2. I expect all the
Scott, thank you, but it seems I'd need to be logged in to report a suspected
bug. I'm not a kafka developer, just a user..
> On Jul 7, 2016, at 4:23 PM, Scott Hirleman wrote:
>
> I would imagine the JIRA is the best place:
> https://issues.apache.org/jira/browse/KAFKA/
>
> On Thu, Jul 7, 2
Hello Guys.
Have tried a lot, from kafka.javaapi. etc to Producer to KafkaProducer, and
am working with 0.9.0.0
This is the error I am getting :
org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
after 62 ms.
at
org.apache.kafka.clients.producer.KafkaProducer$FutureFailur
We had an issue last week when kafka cluster reported under replicated
partitions for quite a while but there were no brokers down. All the
brokers were reporting unknownException on Broker 1. When checked broker 1
logs, it just reported below errors(NotAssignedReplicaException)
continuously. Issue
Hi, all,
How to know the producers of one topic?
I always receive some dirty message from somebody , but I don’t know who
produce them.
Can some cmd help me?
xianda
Hello,
I have a question about Kafka.
Actually, I produce NetFlow metrics on my Cisco router. I want know if it's
possible to send NetFlow metrics to Kafka broker to resend this in Logstash
server ?
Thanks for your answer.
Have a nice day.
Mathieu OZERAY
Anyone can create a JIRA account, including users.
Ismael
On Tue, Jul 12, 2016 at 3:10 PM, Fumo, Vincent
wrote:
> Scott, thank you, but it seems I'd need to be logged in to report a
> suspected bug. I'm not a kafka developer, just a user..
>
>
> > On Jul 7, 2016, at 4:23 PM, Scott Hirleman wro
Hi,
Were you rebalancing that topic or partition at that time? If there are
rebalancing bugs this might point at that.
Thanks
Tom
On Tue, Jul 12, 2016 at 6:47 AM, Gokul wrote:
> We had an issue last week when kafka cluster reported under replicated
> partitions for quite a while but there wer
Try increasing timeouts.
On Jul 12, 2016 7:40 AM, "Sumit Khanna" wrote:
> Hello Guys.
>
> Have tried a lot, from kafka.javaapi. etc to Producer to KafkaProducer, and
> am working with 0.9.0.0
> This is the error I am getting :
>
> org.apache.kafka.common.errors.TimeoutException: Failed to update
Thanks. Auto rebalance is set to true, so rebalancing may be happening at
that time. Is there any issue tracker that I can refer to?
On 12 Jul 2016 21:48, "Tom Crayford" wrote:
> Hi,
>
> Were you rebalancing that topic or partition at that time? If there are
> rebalancing bugs this might point at
Ah, that's around leader rebalancing. Do you have any scripts that run
kafka-assign-partitions or similar?
I will recheck but this doesn't sound like a thing that auto rebalance
would impact
On Tuesday, 12 July 2016, Gokul wrote:
> Thanks. Auto rebalance is set to true, so rebalancing may be ha
No, not using any script of that sort. Sure.
Thanks.
On 12 Jul 2016 22:08, "Tom Crayford" wrote:
> Ah, that's around leader rebalancing. Do you have any scripts that run
> kafka-assign-partitions or similar?
>
> I will recheck but this doesn't sound like a thing that auto rebalance
> would impac
Sumit,You need to mention arguments as well.You are passing empty list.for ex:
props.put("bootstrap.servers", "localhost:9092")
From: Sumit Khanna
To: users@kafka.apache.org
Sent: Tuesday, 12 July 2016 4:49 PM
Subject: kafka unable to send records - scala / spark
Hello Guys.
Have
Hi ,
I am getting the below error messages when consuming the records from the
kafka topic .
o.a.k.c.c.internals.ConsumerCoordinator : Error ILLEGAL_GENERATION
occurred while committing offsets for group test-group.
2016-07-11 22:56:50.314 ERROR 8699 --- [ Thread]
o.a.k.c.c.internals.ConsumerCo
Can the kafka-clients Maven bundle at version 0.8.2.1 be used to
communicate with a Kafka 0.10.0.0 server?
Chris
Yes. The expectation is that brokers are backwards compatible: new broker
releases should work with old clients (to 0.8, but not back to 0.7).
The opposite, backwards compatible clients, is generally not supported: new
clients may not always work with old brokers (except for, *cough* *cough*,
kafk
I am trying to send a message from a producer to a kafka node in another DC.
Both the producer and consumer are set with the default 0.0.10.0 configuration
and the message sizes are not so small (around 500k).
Most of the time when sending messages I am encountered with these exceptions:
org.a
Hi Ozery,
Please try mentioning the kafka broker IP and port in cisco collector config
where you will sending your flows.
Thanks,Mudit
From: OZERAY MATHIEU
To: "users@kafka.apache.org"
Sent: Tuesday, 12 July 2016 8:20 PM
Subject: NetFlow metrics to Kafka
Hello,
I have a question
Hello.
I'm not sure whether it's a bug or not, but here is a something wrong;
I set 2 consumer apps that have same consumer group id, and partition has
been set to 1 on my Kafka Broker.
In theory, the messages on the Kafka Broker must be consumed either one,
which means it must not be consumed a
Are you sure the topic itself has indeed 1 partition?
If so the only partition should be matched to either one till some
error/rebalance occurs, does this indeed happen (a lot)?
On Wed, Jul 13, 2016 at 7:19 AM BYEONG-GI KIM wrote:
> Hello.
>
> I'm not sure whether it's a bug or not, but here is
23 matches
Mail list logo
