Relatively minor change with a new metric for MM2
https://cwiki.apache.org/confluence/display/KAFKA/KIP-971%3A+Expose+replication-offset-lag+MirrorMaker2+metric
think it'd
> be worth writing a bit more about it, what it does currently, how it is
> calculated and therefore why it doesn't fit.
>
> Thanks,
> Viktor
>
> On Sat, Aug 26, 2023 at 3:49 PM Elxan Eminov
> wrote:
>
> > Relatively minor change with a new m
g of the replica that is being
> > consumed) and these are min, max, avg across replicas?
> > 2. You briefly mention replication-latency-ms at the end but I think it'd
> > be worth writing a bit more about it, what it does currently, how it is
> > calculated and therefore
ition in `poll`?
>
> best,
> hudeqi
>
>
> > -原始邮件-
> > 发件人: "Elxan Eminov"
> > 发送时间: 2023-09-02 19:18:23 (星期六)
> > 收件人: dev@kafka.apache.org
> > 抄送:
> > 主题: Re: Re: [DISCUSS] KIP-971 Expose replication-offset-lag
> MirrorMaker2 metric
> >
>
is partition. I
> understand that the offset lag introduced here should be the LEO of the
> source cluster minus the offset of the last record to be polled?
>
> best,
> hudeqi
>
>
> > -原始邮件-
> > 发件人: "Elxan Eminov"
> > 发送时间: 2023-09-04 14:52:08
d?
>
> best,
> hudeqi
>
>
> > -原始邮件-
> > 发件人: "Elxan Eminov"
> > 发送时间: 2023-09-04 14:52:08 (星期一)
> > 收件人: dev@kafka.apache.org
> > 抄送:
> > 主题: Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2
> metric
> >
>
hind the LEO of the partition?
Are they big enough to justify the extra call to listOffsets?
@Viktor, any thoughts?
Thanks,
Elkhan
On Mon, 4 Sept 2023 at 09:36, Elxan Eminov wrote:
> I already have the PR for this so if it will make it easier to discuss,
> feel free to take a look: http
which task may
> have
> > > > performance problems; and if you monitor the overall offset lag of
> the
> > > > topic, then using the
> > > > "kafka_consumer_consumer_fetch_manager_metrics_records_lag" metric
> > will be
> > > >
Hi Viktor and huqedi,
I've made the changes to the KIP.
I added the configurable poll interval as an optional - I believe it is
useful to let users to configure it but I doubt whether it would actually
be used.
Please let me know your thoughts on this,
Thanks!
On Sat, 26 Aug 2023 at 15:49,
Hi Team,
Just pinging this
Thanks,
Elkhan
On Thu, 21 Sep 2023 at 23:09, Elxan Eminov wrote:
> Hi Viktor and huqedi,
> I've made the changes to the KIP.
> I added the configurable poll interval as an optional - I believe it is
> useful to let users to configure it but I doubt
e users might want longer periods
> to avoid any unnecessary pressure from MM2.
>
> Viktor
>
> On Wed, Sep 27, 2023 at 12:50 AM Elxan Eminov
> wrote:
>
> > Hi Team,
> > Just pinging this
> >
> > Thanks,
> > Elkhan
> >
> > On Thu, 21 S
Hey Mickael,
Just checking to see if you have any thoughts on this.
thanks!
On Thu, 11 Apr 2024 at 15:11, Elxan Eminov wrote:
> Hi Mickael!
> Any thoughts on this?
> Thanks!
>
> On Wed, 3 Apr 2024 at 13:21, Elxan Eminov wrote:
>
>> Hi Mickael,
>> Thanks for you
Hi Viktor,
Apologies, didn't get time to spare for this one.
I will add the proposed config name to the KIP and propose a vote.
Thanks!
On Mon, 4 Dec 2023 at 16:14, Viktor Somogyi-Vass <
viktor.somo...@cloudera.com> wrote:
> Elkhan, do you want to propose a vote for this KIP or do you have any
>
Hi all,
I've updated the KIP with the details we discussed in this thread.
I'll call in a vote after the holidays if everything looks good.
Thanks!
On Sat, 26 Aug 2023 at 15:49, Elxan Eminov wrote:
> Relatively minor change with a new metric for MM2
>
> https://cwiki.ap
Hi All,
I'd like to initiate a vote for KIP-971.
This KIP is about adding a new metric to the MirrorSourceTask that tracks
the offset lag between a source and a target partition.
KIP link:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-971%3A+Expose+replication-offset-lag+MirrorMaker2+metri
Hi all,
Here is the vote thread:
https://lists.apache.org/thread/ftlnolcrh858dry89sjg06mdcdj9mrqv
Cheers!
On Wed, 27 Dec 2023 at 11:23, Elxan Eminov wrote:
> Hi all,
> I've updated the KIP with the details we discussed in this thread.
> I'll call in a vote after the hol
Hi all,
Bumping this for visibility
On Wed, 3 Jan 2024 at 18:13, Elxan Eminov wrote:
> Hi All,
> I'd like to initiate a vote for KIP-971.
> This KIP is about adding a new metric to the MirrorSourceTask that tracks
> the offset lag between a source and a target partition.
>
gt;
> Thanks,
> Mickael
>
> On Wed, Jan 3, 2024 at 6:15 PM Elxan Eminov
> wrote:
> >
> > Hi all,
> > Here is the vote thread:
> > https://lists.apache.org/thread/ftlnolcrh858dry89sjg06mdcdj9mrqv
> >
> > Cheers!
> >
> > On Wed, 27 Dec
e case for this
> new feature or will this setting only accept positive values?
> I also wonder if replication-lag, or record-lag would be clearer names
> instead of replication-offset-lag, WDYT?
>
> Thanks,
> Mickael
>
> On Wed, Jan 3, 2024 at 6:15 PM Elxan Eminov
> wr
t the others think about it.
>
> Thanks,
> Mickael
>
> On Mon, Jan 15, 2024 at 9:50 PM Elxan Eminov
> wrote:
> >
> > Apologies, forgot to reply on your last comment about the metric name.
> > I believe both replication-lag and record-lag are a little too abstract
Hi All,
Since I changed the name of the KIP, the prev. long link doesn't work
anymore.
Here is the shortlink: https://cwiki.apache.org/confluence/x/95OzDw
Thanks
On Fri, 19 Jan 2024 at 18:08, Elxan Eminov wrote:
> Hi Mickael,
> Thanks for your feedback.
>
> I've upda
> > > +1 (non-binding)
> > > Thanks for the KIP, this will be a very useful metric for MM!
> > > Daniel
> > >
> > > Elxan Eminov ezt írta (időpont: 2024. jan.
> 7.,
> > > V,
> > > 2:17):
> > >
> > > > Hi all,
> > >
ics and configuration
> names should match too. Let's see what the others think about it.
>
> Thanks,
> Mickael
>
> On Mon, Jan 15, 2024 at 9:50 PM Elxan Eminov
> wrote:
> >
> > Apologies, forgot to reply on your last comment about the metric name.
> > I
cation.record.lag.metric.refresh.interval?
>
> Thanks,
> Mickael
>
> On Mon, Feb 5, 2024 at 5:23 PM Elxan Eminov
> wrote:
> >
> > Hi Mickael!
> > Any further thoughts on this?
> >
> > Thanks,
> > Elkhan
> >
> > On Thu, 18 Jan 2024 a
Hi Mickael!
Any thoughts on this?
Thanks!
On Wed, 3 Apr 2024 at 13:21, Elxan Eminov wrote:
> Hi Mickael,
> Thanks for your response and apologies for a huge delay in mine.
>
> My thinking is that any partition could go stale if there are no records
> being produced into it. If
Hi,
I'd like to request permissions to contribute to Apache Kafka,
my wiki and jira ID's are "elkkhan"
Thanks!
26 matches
Mail list logo
