Thanks, Mani. IT seems the jmx code for GC log rotate has not been added to
our run-class.sh in any of the server in the cluster. Also are there any
best practice to restart the kafka service on broker in the cluster?
Or we can just restart the service on all the broker server one by one and
the re
Hello Parth,
I would recommend avoiding rapid restarts, it means, restarting the Brokers
immediately one after the other, also (in my opinion, avoid restarting the
Brokers all at once).
According to my experience and my opinion, it is better to restart one by
one, but wait until the restarted Brok
Thanks. I assume this will be fixed in 2.1.1?
On Thu, 6 Dec 2018 at 01:11 Guozhang Wang wrote:
> Hmm.. seems like a regression introduced in since
> "getExpiredInflightBatches".
>
> Actually, just found someone already file a JIRA with a PR:
> https://github.com/apache/kafka/pull/6005/files
>
>
If the properties are not available per-connector, then you will have to
set them on the worker and have independent Kafka Connect clusters
delineated by connector requirements. So long as you configure the ports
not to clash, there's no reason these can't exist on the same host.
--
Robin Moffa
Hello
We have eight countries, each country have three connectors .total 24
connectors but we have one worker cluster , every time kafka connect worker
need to restart
In this case how we can manage , pls suggest
Regards
Lakshman
> On 6 Dec 2018, at 9:49 PM, Robin Moffatt wrote:
>
> If t
Thanks robin
Usually how many connectors can load on one worker to have independent kafka
connect cluster
Thanks
Lakshman
Sent from my iPhone
> On 6 Dec 2018, at 9:49 PM, Robin Moffatt wrote:
>
> If the properties are not available per-connector, then you will have to
> set them on the wor
+users
On Thu, Dec 6, 2018 at 9:01 PM Suman B N wrote:
> Team,
>
> We are observing ISR shrink and expand very frequently. In the logs of the
> follower, below errors are observed:
>
> [2018-12-06 20:00:42,709] WARN [ReplicaFetcherThread-2-15], Error in fetch
> kafka.server.ReplicaFetcherThread$
Yes. We will merge to trunk and cherry-pick to 2.1 branch.
Guozhang
On Thu, Dec 6, 2018 at 5:43 AM Mark Anderson wrote:
> Thanks. I assume this will be fixed in 2.1.1?
>
> On Thu, 6 Dec 2018 at 01:11 Guozhang Wang wrote:
>
> > Hmm.. seems like a regression introduced in since
> > "getExpiredI
Hi,
I'm currently testing how Kafka reacts in cases of broker failure due to
process failure or network timeout.
I'd like to have the election of a new leader for a topic partition happen
as quickly as possible but it is unclear from the documentation or broker
configuration what the key paramete
Hi Mark,
If a broker fails and you want to elect a new leader as quickly as
possible, you could tweak zookeeper.session.timeout.ms in the kafka broker
configuration. According to the documentation: "If the consumer fails to
heartbeat to ZooKeeper for this period of time it is considered dead and a
We're trying to use Kafka Connect to pull down data from Kafka, but we're
having issues with the Avro deserialization.
When we attempt to consume data using the kafka-avro-console-consumer, we
can consume it, and deserialize it correctly. Our command is similar to
the following:
*./kafka-avro-co
Hi Marco,
We've seen this issue when the actual message is not encoded with a schema.
In our case we had to refactor our producer slightly, as it wasn't
including the magic byte in the messages.
Cheers,
Patrick
On Thu, 6 Dec 2018, 19:30 Marcos Juarez, wrote:
> We're trying to use Kafka Connec
Guys,
Another observation is 90% of under-replicated partitions have the same
node as the follower.
*Any help in here is very much appreciated. We have very less time to
stabilize kafka. Thanks a lot in advance.*
-Suman
On Thu, Dec 6, 2018 at 9:08 PM Suman B N wrote:
> +users
>
> On Thu, Dec 6
Hi Mark,
The leader election of a new topic partition happens once the controller
detects that the Leader has crashed.
This happens asynchronously via a zookeeper listener. Once a zookeeper
listener is fired, the corresponding object indicating the event happened
is put in to a controller queue.
T
Can someone clarify the usage and requirements of consumer ID when
used/specified?
I came across this topic and brought that up in a comment in the thread,
someone else suggested it being worthy of another post
https://stackoverflow.com/questions/34550873/difference-between-groupid-and-consumerid
15 matches
Mail list logo
