Hello,
I am requesting permissions to contribute to Apache Kafka.
Wiki ID: kw2412
Jira ID: kevinwu2412
Best,
Kevin Wu
Hey all,
I posted a KIP to monitor broker startup and controlled shutdown on the
controller-side. Here's the link:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1131%3A+Controller-side+monitoring+for+broker+shutdown+and+startup
Best,
Kevin Wu
exposes its state. I
think it would be helpful to enumerate some specific cases though for the
KIP.
On Thu, Feb 27, 2025 at 2:19 PM Kevin Wu wrote:
> I guess my concern is that the time-based metrics would reset to 0 on
>> every failover (if I understand the proposed implementation corr
Hello all,
I am manually bumping this thread.
Any feedback or votes would be appreciated.
Best regards,
Kevin Wu
On Thu, Mar 13, 2025 at 1:54 PM Kevin Wu wrote:
> Hello all,
>
> I would like to call a vote for KIP-1131: Improved controller-side
> monitoring of broker state
Hey Colin,
> How about something like this? > 10 = fenced > 20 = controlled shutdown >
30 = active
Yeah, that seems reasonable to me. Thanks for the suggestion.
Kevin
On Mon, Apr 14, 2025 at 12:42 PM Kevin Wu wrote:
> Thanks for the comments Federico.
>
> > I
Hey PoAn,
I might be wrong, but I thought you were a committer? If so, are you
willing to change your vote to be binding if the changes look good, so the
KIP is accepted?
Best regards,
Kevin
On Tue, Mar 25, 2025 at 5:29 PM Kevin Wu wrote:
> Hello all,
>
> I am manually bumping th
artbeat timeout.
> Why? Wouldn't it be a useful report the entire time since the last
> heartbeat? That is more information instead of just reporting the
> value up to the heartbeat timeout.
>
> Thanks,
> --
> -José
>
On Thu, Mar 6, 2025 at 1:58 PM Kevin Wu wrote:
ting the existing
metrics will lead to compatibility issues with current monitoring setups.
On Mon, Apr 14, 2025 at 12:25 PM Kevin Wu wrote:
> Thanks for the comments Jose.
> For 1 and 2, I've changed the naming of the metrics to follow your
> suggestion of tags/attributes. For
Hey Jose,
Yeah, that was an initial discussion point that isn't going to be
implemented. I'll move it to "rejected alternatives" and remove the
"proposed changes" section. Thanks for the feedback.
Best,
Kevin
On Mon, Apr 14, 2025 at 4:31 PM Kevin Wu wrote:
etric: name = BrokersRegisteredAndFenced, value = "kafka-2,kafka-3"
- Metric: name = BrokersRegisteredRegisteredAndUnfenced, value =
"kafka-4,kafka-5"
I guess there will be overlap between the second and third metrics, but
there do exist metrics that expose `Gauge` values
/z8cwnksl6op4jfg7j0nwsg9xxsf8mwhh
Thanks for the reviews,
Kevin Wu
a metric for
it and assign it a value of 0. Is a value of 0 for brokers that shutdown?
In that case, doesn't that make the metric cardinality worse? I think if we
decide to go that route we should only have states 1, 2, and 3.
Best,
Kevin Wu
On 2025/02/20 00:22:00 Colin McCabe wrote:
&g
a metric for
it and assign it a value of 0. Is a value of 0 for brokers that shutdown?
In that case, doesn't that make the metric cardinality worse? I think if we
decide to go that route we should only have states 1, 2, and 3.
Best,
Kevin Wu
On Mon, Jan 27, 2025 at 12:56 PM Kevin Wu wr
Hello all,
I wrote a KIP to add a generic feature level metric.
Here's the link:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1180%3A+Add+a+generic+feature+level+metric
Thanks,
Kevin Wu
Hey Jose,
Thanks for the response. Yeah, the new metric should expose
metadata.version as well. Let me update the KIP to reflect that.
Thanks,
Kevin Wu
On Wed, May 7, 2025 at 2:54 PM Kevin Wu wrote:
> Hello all,
>
> I wrote a KIP to add a generic feature level metric.
> Her
Hey Chia-Ping and Justine,
Okay, that makes sense about the minimum version changing at some point.
I'll add these metrics to this KIP. Thanks for the insightful discussion.
Best,
Kevin Wu
On Fri, May 9, 2025 at 4:54 PM Kevin Wu wrote:
> Hey Chia-Ping and Justine,
>
>
at 3:10 PM Kevin Wu wrote:
> Hey Jose,
>
> Thanks for the response. Yeah, the new metric should expose
> metadata.version as well. Let me update the KIP to reflect that.
>
> Thanks,
> Kevin Wu
>
> On Wed, May 7, 2025 at 2:54 PM Kevin Wu wrote:
>
>> Hello all
nks,
Kevin
On Thu, May 8, 2025 at 6:06 PM Kevin Wu wrote:
> Hey Chia-Ping,
>
> I hadn't considered adding the supported versions for each feature as a
> metric, but I'm not sure if it's helpful for monitoring the progress of an
> upgrade/downgrade of a feature.
ase.
Best,
Kevin Wu
On Mon, May 12, 2025 at 9:05 AM Kevin Wu wrote:
> Hey Chia-Ping and Justine,
>
> Okay, that makes sense about the minimum version changing at some point.
> I'll add these metrics to this KIP. Thanks for the insightful discussion.
>
> Best,
> Kevin W
perator that an upgrade/downgrade of the
feature was completed on every node.
Best,
Kevin Wu
On Thu, May 8, 2025 at 9:04 AM Kevin Wu wrote:
> Hey Jun,
>
> Thanks for the comments.
> 1. I'll update the KIP. My trunk is a bit stale.
> 2. Yeah, the metric should report the fin
tadataLoader metrics, since we derive its value from feature records in
the metadata log.
PY_0: Okay, I will update the section with a link to KIP-1160.
Thanks,
Kevin
On Tue, May 13, 2025 at 8:56 AM Kevin Wu wrote:
> Hey Jun,
>
> Thanks for the comments:
> 4. Maybe I'
insightful discussion,
Kevin Wu
Kevin Wu created KAFKA-17713:
Summary: Ensure snapshots are aligned to batch boundaries
Key: KAFKA-17713
URL: https://issues.apache.org/jira/browse/KAFKA-17713
Project: Kafka
Issue Type: Bug
[
https://issues.apache.org/jira/browse/KAFKA-17713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-17713.
--
Resolution: Done
[https://github.com/apache/kafka/pull/17398] merged.
> Ensure snapshots are alig
[
https://issues.apache.org/jira/browse/KAFKA-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-17916.
--
Resolution: Fixed
> Convert Kafka Connect system tests to use KR
Kevin Wu created KAFKA-17916:
Summary: Convert Kafka Connect system tests to use KRaft
Key: KAFKA-17916
URL: https://issues.apache.org/jira/browse/KAFKA-17916
Project: Kafka
Issue Type
Kevin Wu created KAFKA-17915:
Summary: Convert Kafka Client tests to use KRaft
Key: KAFKA-17915
URL: https://issues.apache.org/jira/browse/KAFKA-17915
Project: Kafka
Issue Type: Improvement
Kevin Wu created KAFKA-17917:
Summary: Convert Kafka core system tests to use KRaft
Key: KAFKA-17917
URL: https://issues.apache.org/jira/browse/KAFKA-17917
Project: Kafka
Issue Type: Improvement
Kevin Wu created KAFKA-17803:
Summary: Reconcile Differences in MockLog and KafkaMetadataLog
`read` Implementation
Key: KAFKA-17803
URL: https://issues.apache.org/jira/browse/KAFKA-17803
Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-14619.
--
Resolution: Fixed
> KRaft validate snapshot id are at batch boundr
[
https://issues.apache.org/jira/browse/KAFKA-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-17625.
--
Resolution: Fixed
This work was completed in the following PRs:
* [https://github.com/apache/kafka
Kevin Wu created KAFKA-18679:
Summary: KafkaRaftMetrics metrics are exposing doubles instead of
integers
Key: KAFKA-18679
URL: https://issues.apache.org/jira/browse/KAFKA-18679
Project: Kafka
Kevin Wu created KAFKA-18305:
Summary: validate controller.listener.names is not in
inter.broker.listener.name for kcontrollers
Key: KAFKA-18305
URL: https://issues.apache.org/jira/browse/KAFKA-18305
[
https://issues.apache.org/jira/browse/KAFKA-18305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-18305.
--
Fix Version/s: 4.0.0
Resolution: Fixed
> validate controller.listener.names is not
[
https://issues.apache.org/jira/browse/KAFKA-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-17917.
--
Fix Version/s: 4.0.0
Resolution: Fixed
> Convert Kafka core system tests to use KR
Kevin Wu created KAFKA-18667:
Summary: Add ducktape tests for simultaneous broker + controller
failure
Key: KAFKA-18667
URL: https://issues.apache.org/jira/browse/KAFKA-18667
Project: Kafka
Kevin Wu created KAFKA-18666:
Summary: Controller-side monitoring for broker shutdown and startup
Key: KAFKA-18666
URL: https://issues.apache.org/jira/browse/KAFKA-18666
Project: Kafka
Issue
Kevin Wu created KAFKA-18395:
Summary: Initialize KafkaRaftMetrics without QuorumState to
prevent circularity
Key: KAFKA-18395
URL: https://issues.apache.org/jira/browse/KAFKA-18395
Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-17431.
--
Fix Version/s: 4.1.0
Resolution: Fixed
> KRaft servers require valid static socketser
[
https://issues.apache.org/jira/browse/KAFKA-19228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-19228.
--
Resolution: Won't Fix
Closing with won't fix, since although the current behavior is unde
Kevin Wu created KAFKA-19228:
Summary: Formatting with `--no-initial-controllers` flag should
not write kraft version control record
Key: KAFKA-19228
URL: https://issues.apache.org/jira/browse/KAFKA-19228
Kevin Wu created KAFKA-18956:
Summary: Enable junit tests to optionally use more than one KRaft
controller
Key: KAFKA-18956
URL: https://issues.apache.org/jira/browse/KAFKA-18956
Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wu resolved KAFKA-18667.
--
Resolution: Fixed
> Add ducktape tests for simultaneous broker + controller fail
Kevin Wu created KAFKA-19254:
Summary: Add generic feature level metric
Key: KAFKA-19254
URL: https://issues.apache.org/jira/browse/KAFKA-19254
Project: Kafka
Issue Type: New Feature
Kevin Wu created KAFKA-19255:
Summary: KRaft request manager should support one in-flight
request per request type
Key: KAFKA-19255
URL: https://issues.apache.org/jira/browse/KAFKA-19255
Project: Kafka
45 matches
Mail list logo
