okers -> failed broker
> traffic during catching-up to prevent exhausting storage throughput.
>
> 2020年12月15日(火) 20:56 Gokul Ramanan Subramanian :
>
> > Hi.
> >
> >
> > When a broker crashes and restarts after a long time (say 30 minutes),
> > the
Hi.
When a broker crashes and restarts after a long time (say 30 minutes),
the broker has to do some work to sync all its replicas with the
leaders. If the broker is a preferred replica for some partition, the
broker may become the leader as part of a preferred replica leader
election, while it i
gt; discussion. I’m not aware of anything specific that would prevent the
> change, but I will say that my gut instinct says it wouldn’t be a good idea
> without a truly compelling justification.
>
> Ron
>
> > On Sep 28, 2020, at 8:34 AM, Gokul Ramanan Subramanian <
> gokul2
ino wrote:
> Hi Gokul. I looked back at the discussion thread, and it appears it was an
> arbitrary decision.
>
>
> https://lists.apache.org/thread.html/45c09f226386c0b1dc5f9b36e112882a20414d5900f8d778969e633e%40%3Cdev.kafka.apache.org%3E
>
> Ron
>
> On Thu, Sep 24, 2020
Hi.
I was looking through Kafka code and found that SASL KafkaPrincipals are
not supposed to change upon reauthentication, and if they do, the broker
will kill the TCP connection.
What is the reasoning behind this limitation?
Thanks.
n Wed, Aug 5, 2020 at 5:59 PM Harsha Ch wrote:
> Thanks for the updates Gokul. +1 (binding).
>
> Thanks,
>
> Harsha
>
> On Wed, Aug 05, 2020 at 8:18 AM, Gokul Ramanan Subramanian <
> gokul24...@gmail.com > wrote:
>
> >
> >
> >
> > Hi.
>
Hi.
Thanks for the KIP.
Have you thought about whether it makes sense to support authorizing a
principal for a topic ID rather than a topic name to achieve tighter
security?
Or is the topic ID fundamentally an internal detail similar to epochs used
in a bunch of other places in Kafka?
Thanks.
Hi.
I request the community to kindly resume the voting process for KIP-578. If
you have further comments, we can address those as well.
Thanks and cheers.
On Tue, Jul 21, 2020 at 2:07 PM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Hi.
>
> Can we resume the vot
Hi.
Can we resume the voting process for KIP-578? I have addressed additional
comments by Boyang and Ismael.
Thanks.
On Mon, Jun 8, 2020 at 9:09 AM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Hi. Can we resume the voting process for KIP-578? Thanks.
>
> On Mon, Ju
han what
> was
> > described there on both replication overhead and topic creation/deletion
> > performance.
> >
> > Ismael
> >
> > On Tue, Jun 23, 2020 at 11:10 PM Gokul Ramanan Subramanian <
> > gokul24...@gmail.com> wrote:
> >
> > > Ismael,
go.
>
> best,
> Colin
>
> On Mon, Jun 29, 2020, at 02:14, Gokul Ramanan Subramanian wrote:
> > Hi.
> >
> > Has anyone had luck running Kafka system tests on a Mac. I have a MacOS
> > Mojave 10.14.6. I got Python 3.6.9 using pyenv. However, the command
> &g
7
My Macbook pro has over 4GB of RAM free and between 15-45 % idle CPU. So, I
don't think I am running low on resources.
Is this common? At this rate, the tests would take about 2 days to complete
and there'd probably be lots of failures.
On Mon, Jun 29, 2020 at 11:21 AM Gokul Ramanan Subr
instruction on [1] and it works like a charm.
>
> [1]
> https://github.com/apache/kafka/tree/trunk/tests#running-tests-using-docker
>
>
> > 29 июня 2020 г., в 12:14, Gokul Ramanan Subramanian <
> gokul24...@gmail.com> написал(а):
> >
> > Hi.
> >
&g
Hi.
Has anyone had luck running Kafka system tests on a Mac. I have a MacOS
Mojave 10.14.6. I got Python 3.6.9 using pyenv. However, the command
*ducktape tests/kafkatest/tests* yields the following error, making it look
like some Python incompatibility issue.
$ ducktape tests/kafkatest/tests
Tra
in 2014).
>
> Gwen
>
>
> On Wed, Jun 24, 2020 at 10:40 AM Gokul Ramanan Subramanian <
> gokul24...@gmail.com> wrote:
>
> > I agree that is an option, but is there any reason to not have a 2.3.2
> and
> > 2.4.2 released? If so, it would be nice to know abou
.5.0 and
> completely ignore ZK and TLS. It's completely optional.
>
> Ismael
>
> On Wed, Jun 24, 2020 at 10:20 AM Gokul Ramanan Subramanian <
> gokul24...@gmail.com> wrote:
>
> > Any updates on Kafka 2.3.2 and 2.4.2? Given the complexity of migrating
> >
Any updates on Kafka 2.3.2 and 2.4.2? Given the complexity of migrating
from non-encrypted TLS to encrypted TLS connection for ZooKeeper, it would
be nice to have a bug-free version of 2.3 and 2.4.
Is there a technical reason why we hesitate to get these versions out? Or
is it that no one has got
pics. What about
> framework-level topics from other tools and extensions? (connect,
> streams, confluent metrics, tiered storage, etc.) Is blacklisting
> possible?
>
> 907. What happens if one of the dynamic limit is violated at update
> time? (sorry if it's already explain
nsions? (connect,
> > streams, confluent metrics, tiered storage, etc.) Is blacklisting
> > possible?
> >
> > 907. What happens if one of the dynamic limit is violated at update
> > time? (sorry if it's already explained in the KIP, may have missed it)
> >
>
the perf section? I think master should do
> better than what's described there.
>
> Ismael
>
> On Wed, Apr 1, 2020, 8:28 AM Gokul Ramanan Subramanian <
> gokul24...@gmail.com>
> wrote:
>
> > Hi.
> >
> > I have opened KIP-578, intended to provide
Hi. Can we resume the voting process for KIP-578? Thanks.
On Mon, Jun 1, 2020 at 11:09 AM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Thanks Colin. Have updated the KIP per your recommendations. Let me know
> what you think.
>
> Thanks Harsha for the vote.
>
&
Thanks Colin. Have updated the KIP per your recommendations. Let me know
what you think.
Thanks Harsha for the vote.
On Wed, May 27, 2020 at 8:17 PM Colin McCabe wrote:
> Hi Gokul Ramanan Subramanian,
>
> Thanks for the KIP.
>
> Can you please modify the KIP to remove the r
Hi.
Any votes for this?
Thanks.
On Tue, May 12, 2020 at 11:36 AM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Hello,
>
> I'd like to initialize voting on KIP-578:
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-578%3A+Add+configuration+to+lim
Hello,
I'd like to initialize voting on KIP-578:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-578%3A+Add+configuration+to+limit+number+of+partitions
.
Got some good feedback from Stanislav Kozlovski, Alexandre Dupriez and Tom
Bentley on the discussion thread. I have addressed their comme
if a user's cluster is at the maximum partition capacity, yet a new
> release of Kafka introduces a new topic (e.g KIP-500)?
>
> Best,
> Stanislav
>
> On Fri, Apr 24, 2020 at 2:39 PM Gokul Ramanan Subramanian <
> gokul24...@gmail.com> wrote:
>
> > Hi Tom.
> &
in the KIP how users would be
> expected to arrive at values for these configs (both on day 1 and in an
> evolving production cluster), when this solution might be better than using
> a cluster balancer and/or why cluster balancers can't be trusted to avoid
> overloading broke
gt; be possible following the work to make all ZK writes happen on the
> controller.
>
> Of course, this is just my take on it.
>
> Kind regards,
>
> Tom
>
> On Thu, Apr 16, 2020 at 11:47 AM Gokul Ramanan Subramanian <
> gokul24...@gmail.com> wrote:
>
> >
their thoughts, so that I
can more confidently start the voting thread.
Thanks.
On Thu, Apr 16, 2020 at 11:30 AM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Thanks for your comments Alex.
>
> The KIP proposes using two configurations max.partitions and
> max.bro
aining the objective function and
> reducing the migration path.
>
> Thanks,
> Alexandre
>
> Le jeu. 9 avr. 2020 à 00:19, Gokul Ramanan Subramanian
> a écrit :
> >
> > Hi. Requesting you to take a look at this KIP and provide feedback.
> >
> > Thanks. Rega
Hi. Requesting you to take a look at this KIP and provide feedback.
Thanks. Regards.
On Wed, Apr 1, 2020 at 4:28 PM Gokul Ramanan Subramanian <
gokul24...@gmail.com> wrote:
> Hi.
>
> I have opened KIP-578, intended to provide a mechanism to limit the number
> of partitions
Hi.
I have opened KIP-578, intended to provide a mechanism to limit the number
of partitions in a Kafka cluster. Kindly provide feedback on the KIP which
you can find at
https://cwiki.apache.org/confluence/display/KAFKA/KIP-578%3A+Add+configuration+to+limit+number+of+partitions
I want to speciall
+1 (non binding).
Thanks.
On Tue, Mar 31, 2020 at 2:43 PM Alexandre Dupriez <
alexandre.dupr...@gmail.com> wrote:
> +1 (non binding).
>
> Thanks.
>
> Le mar. 31 mars 2020 à 14:24, M. Manna a écrit :
> >
> > +1 (binding).
> >
> > Thanks for the KIP.
> >
> > On Tue, 31 Mar 2020 at 14:17, Paolo Mo
Hi.
What is the idiomatic / correct way to know that a restarted broker in an
existing Kafka cluster has caught up to all the leaders for the partitions
it hosts? Is there a specific JMX metric published either by the leader /
follower that we can monitor?
Ideally, the metric would have the follo
Hi.
I'd like your thoughts on
https://issues.apache.org/jira/browse/KAFKA-9590?jql=text%20~%20%22limit%20topic%20partitions%22
(tldr:
its about limiting number of topic partitions via a read-only
configuration).
I am going to start writing a KIP for this soon, and will share on this
thread as I m
Gokul Ramanan Subramanian created KAFKA-9590:
Summary: Add read-only configuration to limit number of topic
partitions
Key: KAFKA-9590
URL: https://issues.apache.org/jira/browse/KAFKA-9590
may have similar lag to
> Application
> > >> A, but
> > >> > > because it has a faster processing time its latency per partition
> is
> > >> > > significantly less.
> > >> > >
> > >> > > If the Kafka Consumer reported a latency metric it would be
> easier to
> > >> > > build Service Level Agreements (SLAs) based on non-functional
> > >> requirements
> > >> > > of the streaming system. For example, the system must never have a
> > >> latency
> > >> > > of greater than 10 minutes. This SLA could be used in monitoring
> > >> alerts or
> > >> > > as input to automatic scaling solutions.
> > >> > >
> > >> > > On Thu, Jul 11, 2019 at 12:36 PM Sean Glover <
> > >> sean.glo...@lightbend.com>
> > >> > > wrote:
> > >> > >
> > >> > >> Hi kafka-dev,
> > >> > >>
> > >> > >> I've created KIP-489 as a proposal for adding latency metrics to
> the
> > >> > >> Kafka Consumer in a similar way as record-lag metrics are
> > >> implemented.
> > >> > >>
> > >> > >>
> > >> > >>
> > >>
> https://cwiki.apache.org/confluence/display/KAFKA/489%3A+Kafka+Consumer+Record+Latency+Metric
> > >> > >>
> > >> > >> Regards,
> > >> > >> Sean
> > >> > >>
> > >> > >> --
> > >> > >> Principal Engineer, Lightbend, Inc.
> > >> > >>
> > >> > >> <http://lightbend.com>
> > >> > >>
> > >> > >> @seg1o <https://twitter.com/seg1o>, in/seanaglover
> > >> > >> <https://www.linkedin.com/in/seanaglover/>
> > >> > >>
> > >> > >
> > >> > >
> > >> > > --
> > >> > > Principal Engineer, Lightbend, Inc.
> > >> > >
> > >> > > <http://lightbend.com>
> > >> > >
> > >> > > @seg1o <https://twitter.com/seg1o>, in/seanaglover
> > >> > > <https://www.linkedin.com/in/seanaglover/>
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
> > --
> > Sean Glover
> > Principal Engineer, Alpakka, Lightbend, Inc. <https://lightbend.com>
> > @seg1o <https://twitter.com/seg1o>, in/seanaglover
> > <https://www.linkedin.com/in/seanaglover/>
> >
>
--
Gokul Ramanan Subramanian
Senior SDE, Amazon AWS
ady
> > closed. Rethrowing javax.net.ssl.SSLException: Inbound closed before
> > receiving peer's close_notify: possible truncation attack?
> >
> > [Raw write]: length = 7
> >
> > : 15 03 03 00 02 02 50 ..P
> >
my +1 counts,
since I am a Kafka noob).
Thanks.
Gokul Ramanan Subramanian
Senior SDE, Amazon AWS
On 28/Jul/19 05:43:19PM +0100, Alexandre Dupriez wrote:
Hello,
I have created the KIP-498
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-498%3A+Add+client-side+configuration+for+maxi
Hello Community,
In order to start contributing to Apache Kafka project, could I please request
contributor access to JIRA and be granted write permissions to the Kafka wiki?
My name: Gokul Ramanan Subramanian
JIRA username: gokul2411s
Confluence username: gokul2411s
(https://cwiki.apache.org
39 matches
Mail list logo
