[jira] [Created] (KAFKA-16811) Punctuate Ratio metric almost impossible to track

Sebastien Viale created KAFKA-16811: --- Summary: Punctuate Ratio metric almost impossible to track Key: KAFKA-16811 URL: https://issues.apache.org/jira/browse/KAFKA-16811 Project: Kafka Issue

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

I was not aware of `InternalFixedKeyRecordFactory`. As the name indicates, it's considered an internal class, so not sure if we should recommend to use it in test... I understand why this class is required, and why it was put into a public package; the way Java works, enforces this. Not sure i

Permission to contribute to Apache Kafka

Hi, As I now have my wiki Id: frouleau and my Jira Id: fred-ro, can I have the permission to contribute to KIP ? Regards,

[jira] [Created] (KAFKA-16812) The tools-related tests are slow

Chia-Ping Tsai created KAFKA-16812: -- Summary: The tools-related tests are slow Key: KAFKA-16812 URL: https://issues.apache.org/jira/browse/KAFKA-16812 Project: Kafka Issue Type: Improvement

Re: Permission to contribute to Apache Kafka

Hi Frédérik, I've granted you the necessary permissions. Let me know if something doesn't work as expected. Cheers, Yash On Wed, May 22, 2024 at 1:38 PM Frédérik Rouleau wrote: > Hi, > As I now have my wiki Id: frouleau and my Jira Id: fred-ro, can I have the > permission to contribute to KIP

[jira] [Created] (KAFKA-16813) Add global timeout for "@Test" and "@TestTemplate"

Chia-Ping Tsai created KAFKA-16813: -- Summary: Add global timeout for "@Test" and "@TestTemplate" Key: KAFKA-16813 URL: https://issues.apache.org/jira/browse/KAFKA-16813 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2925

See

[jira] [Created] (KAFKA-16814) KRaft broker cannot startup when `partition.metadata` is missing

Luke Chen created KAFKA-16814: - Summary: KRaft broker cannot startup when `partition.metadata` is missing Key: KAFKA-16814 URL: https://issues.apache.org/jira/browse/KAFKA-16814 Project: Kafka I

[DISCUSS] KIP-1048 Improve kafka-consumer-perf-test to benchmark single partition

Hi, I would like to propose a change in the kafka-consumer-perf-test tool to support perf testing specific partitions. kafka-consumer-perf-test is a great tool to quickly check raw consumer performance. Currently, It subscribes to all the partitions and gives overall cluster performance, however

[DISCUSS] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

Hi I would like to propose a change in the kafka-stream summary log。 Now the summary of stream-tread is record every two minutes, and not support close or update intervals. When the kafka is running， this is absolutely unnecessary and even harmful since it fills the logs and thus storage spac

[jira] [Created] (KAFKA-16815) Handle FencedInstanceId on heartbeat for new consumer

Lianet Magrans created KAFKA-16815: -- Summary: Handle FencedInstanceId on heartbeat for new consumer Key: KAFKA-16815 URL: https://issues.apache.org/jira/browse/KAFKA-16815 Project: Kafka Iss

[DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Hi team, Chia-Ping Tsai and I would like to propose KIP-1047 to migrate kafka.serializer.Decoder from core module (scala) to tools module (java). Feedback and comments are welcome. KIP-1047: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1047+Introduce+new+org.apache.kafka.tools.api.Dec

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Dear all, We know that 3.8.0 KIP is already frozen, but this is a small KIP and we need to ship it to 3.8.0 so as to remove the deprecated scala interface from 4.0. Best, Chia-Ping On 2024/05/22 14:05:16 Frank Yang wrote: > Hi team, > > Chia-Ping Tsai and I would like to propose KIP-1047 to m

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Hi, Thanks for the KIP. Sorting this out in 3.8.0 would be really nice as it would allow us to migrate this tool in 4.0.0. We're unfortunately past the KIP deadline but maybe this is small enough to have an exception. I'm wondering whether we need to introduce a new Decoder interface and instead

[jira] [Created] (KAFKA-16816) Remove unneeded FencedInstanceId support on commit path for new consumer

Lianet Magrans created KAFKA-16816: -- Summary: Remove unneeded FencedInstanceId support on commit path for new consumer Key: KAFKA-16816 URL: https://issues.apache.org/jira/browse/KAFKA-16816 Project:

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Thanks for Mickael response! >I'm wondering whether we need to introduce a new Decoder interface and instead if we could reuse Deserializer. We could deprecate the key-decoder-class and value-decoder-class flags and introduce new flags like key-deserializer-class and value-deserializer-class. One

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

> One issue I also noted is that some of the existing Decoder implementations (StringDecoder for example) can accept configurations but currently DumpLogSegments does not provide a way to pass any configurations, it creates an empty VerifiableProperties object each time it instantiates a Decoder in

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Hi all, We can add this to 3.8.0, but keep in mind the KIP is not voted yet (as far as I can see), so I would highly encourage to start the vote thread ASAP and strat with the implementation right after. Best, - Josep Prat Open Source Engineering Director, aivenjosep.p...@aiven.i

[jira] [Resolved] (KAFKA-15041) Source Connector auto topic creation fails when topic is deleted and brokers don't support auto topic creation

[ https://issues.apache.org/jira/browse/KAFKA-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao resolved KAFKA-15041. --- Resolution: Won't Fix For now, setting the config `producer.override.max.block.ms` at a connector c

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

Hi! I had a look at the KIP-932, and it seems KafkaShareConsumer is to be configured the same way as the normal consumer using key-value props. As I understand correctly, no adaptation is needed for it to benefit from KIP-899? Meanwhile, the PR [1] is open for review. If there are comments that

[jira] [Created] (KAFKA-16818) Move event-processing tests from ConsumerNetworkThreadTest to ApplicationEventProcessorTest

Kirk True created KAFKA-16818: - Summary: Move event-processing tests from ConsumerNetworkThreadTest to ApplicationEventProcessorTest Key: KAFKA-16818 URL: https://issues.apache.org/jira/browse/KAFKA-16818

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

Thanks for Josep's response > We can add this to 3.8.0, but keep in mind the KIP is not voted yet (as far as I can see), so I would highly encourage to start the vote thread ASAP and strat with the implementation right after. sure. We will file a draft PR at the same time! Josep Prat 於 2024年5月2

[jira] [Resolved] (KAFKA-12399) Deprecate Log4J Appender KIP-719

[ https://issues.apache.org/jira/browse/KAFKA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-12399. Fix Version/s: 3.8.0 Resolution: Fixed > Deprecate Log4J Appender KIP-719 > ---

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

Hi, Ivan, Thanks for the reply. KafkaShareConsumer doesn't take all configuration values from KafkaConsumer. So, we need to make a note that this new config will be part of KafkaShareConsumer too. Jun On Wed, May 22, 2024 at 9:45 AM Ivan Yurchenko wrote: > Hi! > > I had a look at the KIP-932,

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

Hi, I’ll add an item to the plan for KIP-932 to do this for the KafkaShareConsumer. My guess is that there will be actually nothing to do in practice because of code in common with the KafkaConsumer, but definitely worth me checking it out. Thanks, Andrew > On 22 May 2024, at 18:28, Jun Rao wrot

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

Hi Greg, Hope you had a nice weekend! Gonna try to keep things concise. Concluded points: RE version recommenders, I agree it's likely that programmatic UIs will already be able to handle dynamic configuration definitions, and the detail about SMTs is a great point. I still anticipate some awkwa

[jira] [Created] (KAFKA-16819) CoordinatorRequestManager seems to return 0ms during the coordinator discovery

Philip Nee created KAFKA-16819: -- Summary: CoordinatorRequestManager seems to return 0ms during the coordinator discovery Key: KAFKA-16819 URL: https://issues.apache.org/jira/browse/KAFKA-16819 Project: K

[jira] [Created] (KAFKA-16820) Kafka Broker fails to connect to Kraft Controller with no DNS matching

Arushi Helms created KAFKA-16820: Summary: Kafka Broker fails to connect to Kraft Controller with no DNS matching Key: KAFKA-16820 URL: https://issues.apache.org/jira/browse/KAFKA-16820 Project: Kafk

[jira] [Created] (KAFKA-16821) Create a new interface to store member metadata

Ritika Reddy created KAFKA-16821: Summary: Create a new interface to store member metadata Key: KAFKA-16821 URL: https://issues.apache.org/jira/browse/KAFKA-16821 Project: Kafka Issue Type: S

[jira] [Created] (KAFKA-16822) Abstract consumer group in coordinator to share functionality with share group

Apoorv Mittal created KAFKA-16822: - Summary: Abstract consumer group in coordinator to share functionality with share group Key: KAFKA-16822 URL: https://issues.apache.org/jira/browse/KAFKA-16822 Proj

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

Hey Mickael, Just checking to see if you have any thoughts on this. thanks! On Thu, 11 Apr 2024 at 15:11, Elxan Eminov wrote: > Hi Mickael! > Any thoughts on this? > Thanks! > > On Wed, 3 Apr 2024 at 13:21, Elxan Eminov wrote: > >> Hi Mickael, >> Thanks for your response and apologies for a hug

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2926

See

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

Hey Chris, Thanks for your comments, and I'm glad that it seems like we're aligning on the vision here. > An > alternative could be to change existing behavior to fail fast on any > invalid default converter configuration instead of just for invalid > versions I suppose if this is landing in 4.0

Re: [DISCUSS] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

Thanks for the KIP! I'm not against adding this as a config for this per se, but if this is causing you trouble right now you should be able to disable it via log4j configuration so you don't need to wait for a fix in Kafka Streams itself. Putting something like this in your log4j will shut off th

[jira] [Created] (KAFKA-16823) Extract LegacyConsumer-specific unit tests from generic KafkaConsumerTest

Lianet Magrans created KAFKA-16823: -- Summary: Extract LegacyConsumer-specific unit tests from generic KafkaConsumerTest Key: KAFKA-16823 URL: https://issues.apache.org/jira/browse/KAFKA-16823 Projec

[jira] [Created] (KAFKA-16824) Utils.getHost and Utils.getPort do not catch a lot of invalid host and ports

José Armando García Sancio created KAFKA-16824: -- Summary: Utils.getHost and Utils.getPort do not catch a lot of invalid host and ports Key: KAFKA-16824 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Resolved] (KAFKA-16160) AsyncKafkaConsumer is trying to connect to a disconnected node in a tight loop

[ https://issues.apache.org/jira/browse/KAFKA-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee resolved KAFKA-16160. Resolution: Cannot Reproduce > AsyncKafkaConsumer is trying to connect to a disconnected node in a

[jira] [Created] (KAFKA-16825) CVE vulnerabilities in Jetty and netty

mooner created KAFKA-16825: -- Summary: CVE vulnerabilities in Jetty and netty Key: KAFKA-16825 URL: https://issues.apache.org/jira/browse/KAFKA-16825 Project: Kafka Issue Type: Task Affects Versi

[jira] [Resolved] (KAFKA-16793) Heartbeat API for upgrading ConsumerGroup

[ https://issues.apache.org/jira/browse/KAFKA-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16793. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed > Heartbeat API for