Re: What are the biggest issues with Apache Kafka?

2023-08-11 Thread Divij Vaidya
Hey Liam Thanks for asking this question. I have been meaning to write a post to the community for a long time about potential open areas where newcomers can contribute but it never made it to priority in my to-do list. In addition to what others mentioned above, here's a couple of options to pic

[jira] [Created] (KAFKA-15335) Support custom SSL configuration for Kafka Connect RestServer

2023-08-11 Thread Taras Ledkov (Jira)
Taras Ledkov created KAFKA-15335: Summary: Support custom SSL configuration for Kafka Connect RestServer Key: KAFKA-15335 URL: https://issues.apache.org/jira/browse/KAFKA-15335 Project: Kafka

Re: [VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-11 Thread Lucas Brutschy
+1 (non-binding) On Fri, Aug 11, 2023 at 1:08 AM Matthias J. Sax wrote: > > +1 (binding) > > On 8/10/23 12:31 PM, Florin Akermann wrote: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2090

2023-08-11 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-11 Thread Bill Bejeck
+1(binding) On Fri, Aug 11, 2023 at 7:33 AM Lucas Brutschy wrote: > +1 (non-binding) > > On Fri, Aug 11, 2023 at 1:08 AM Matthias J. Sax wrote: > > > > +1 (binding) > > > > On 8/10/23 12:31 PM, Florin Akermann wrote: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2091

2023-08-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-714: Client metrics and observability

2023-08-11 Thread Tom Bentley
Hi Andrew, Thanks for picking this KIP up. I know you've started a vote, so these are unhelpfully late... sorry about that, but hopefully they're still useful. 1. "The Kafka Java client provides an API for the application to read the generated client instance id to assist in mapping and identific

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

2023-08-11 Thread Jeff Kim
Hi Calvin, Thanks for the KIP! I'm still digesting it but I have two questions: > In the scenario raised in the motivation section, the server may receive ack=1 messages during T1 and advance High Watermark when the leader is the only one in ISR. To confirm, the current protocol allows advancing

[jira] [Created] (KAFKA-15336) Connect plugin Javadocs should mention serviceloader manifests

2023-08-11 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15336: --- Summary: Connect plugin Javadocs should mention serviceloader manifests Key: KAFKA-15336 URL: https://issues.apache.org/jira/browse/KAFKA-15336 Project: Kafka

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-11 Thread Igor Fomenko
Matthias, I think that I clouded this discussion a bit with the possible 'fat' message requirement for the one specific use case that I worked on. Therefore I would like to take a step back and to focus just on the actual KIP-955 that only proposes to create a stream-table join on foreign key. Thi

[jira] [Resolved] (KAFKA-15023) Get rack information for source topic partitions for a task

2023-08-11 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-15023. Fix Version/s: 3.6.0 Resolution: Fixed > Get rack information for source topic partitions for a tas

[jira] [Resolved] (KAFKA-15024) Add cost function for task/client

2023-08-11 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-15024. Fix Version/s: 3.6.0 Resolution: Fixed > Add cost function for task/client > --

[jira] [Resolved] (KAFKA-15027) Implement rack aware assignment for standby tasks

2023-08-11 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-15027. Fix Version/s: 3.6.0 Resolution: Fixed > Implement rack aware assignment for standby tasks > --

[jira] [Resolved] (KAFKA-15025) Implement min-cost flow without balancing tasks for same subtopology

2023-08-11 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-15025. Fix Version/s: 3.6.0 Resolution: Fixed > Implement min-cost flow without balancing tasks for same s

[jira] [Resolved] (KAFKA-15054) Add configs and logic to decide if rack aware assignment should be enabled

2023-08-11 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-15054. Fix Version/s: 3.6.0 Resolution: Fixed > Add configs and logic to decide if rack aware assignment s

[jira] [Resolved] (KAFKA-13197) KStream-GlobalKTable join semantics don't match documentation

2023-08-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13197. - Fix Version/s: 3.6.0 3.5.2 Resolution: Fixed > KStream-GlobalK

RE: [DISCUSS] KIP-942: Add Power(ppc64le) support

2023-08-11 Thread Vaibhav Nazare
Hi Divij, 1.No the different versions of JVM don't work differently for power architecture. It will be sufficient if we just run it with the latest supported JDK (20) + latest supported scala (2.13) 2. The plan has been updated accordingly for rejected alternatives -Original Message- Fr

[GitHub] [kafka-site] jolshan commented on pull request #537: MINOR: Add Lucas Bradstreet to committers

2023-08-11 Thread via GitHub
jolshan commented on PR #537: URL: https://github.com/apache/kafka-site/pull/537#issuecomment-1675403860 Hmm - you should be able to merge this too. If you don't you may want to check your permissions. 😅 (See I merged my own -- https://github.com/apache/kafka-site/pull/473) But I ca

[GitHub] [kafka-site] jolshan merged pull request #537: MINOR: Add Lucas Bradstreet to committers

2023-08-11 Thread via GitHub
jolshan merged PR #537: URL: https://github.com/apache/kafka-site/pull/537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2092

2023-08-11 Thread Apache Jenkins Server
See Changes: -- [...truncated 401822 lines...] [INFO] --- compiler:3.1:compile (default-compile) @ streams.examples --- [INFO] Changes detected - recompiling the module! [I

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #58

2023-08-11 Thread Apache Jenkins Server
See Changes: -- [...truncated 285233 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 177 > VersionedKeyValueStoreIntegrationTest > shouldSetChangelog

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2093

2023-08-11 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-08-11 Thread Jack Tomy
Hey everyone, Please consider this as a gentle reminder. On Mon, Aug 7, 2023 at 5:55 PM Jack Tomy wrote: > Hey everyone. > > I would like to call for a vote on KIP-953: partition method to be > overloaded to accept headers as well. > > KIP : > https://cwiki.apache.org/confluence/pages/viewpage.

Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-08-11 Thread Sagar
Hey jack , +1 (non binding) Sagar. On Sat, 12 Aug 2023 at 8:04 AM, Jack Tomy wrote: > Hey everyone, > > Please consider this as a gentle reminder. > > On Mon, Aug 7, 2023 at 5:55 PM Jack Tomy wrote: > > > Hey everyone. > > > > I would like to call for a vote on KIP-953: partition method to be

Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-08-11 Thread Chris Egerton
Hi Jack, +1 (binding) Some friendly, non-blocking suggestions: - IMO it's still worth specifying that the headers will be read-only; this clarifies the intended API contract both for reviewers of the KIP who haven't read the GitHub PR yet, and for developers who may leverage this new method - Ma