Re: [DISCUSS] KIP-401 TransformerSupplier/ProcessorSupplier enhancements

I think the discussion mixed approaches a little bit, hence, let me rephrase my understanding: A) add new method with default implementation to `ProcessorSupplier`: For this case, we don't add a new interface, but only add a new method to `ProcessorSupplier` -- to keep backward compatibility, we

Re: [DISCUSS] KIP-315: Stream Join Sticky Assignor

A `StickyRangeAssignor` is not the same as a `JoinAssignor` that needs to do co-partitioning. Also, does "sticky" assignment and "range" assignment not contradict each other a little bit? >> Regarding how I am using a KV store instead of a kafka compacted topic: I >> simply prepend my keys with

Re: [DISCUSSION] KIP-418: A method-chaining way to branch KStream

Interesting discussion. I am wondering, if we cannot unify the advantage of both approaches: KStream#split() -> KBranchedStream // branch is not easily accessible in current scope KBranchedStream#branch(Predicate, Consumer) -> KBranchedStream // assign a name to the branch and // return the

Build failed in Jenkins: kafka-trunk-jdk11 #567

See Changes: [github] MINOR: Update jackson to 2.9.9 (#6798) -- [...truncated 2.68 MB...] org.apache.kafka.connect.transforms.CastTest > testConfigInvalidMap PASSED org.a

Re: [DISCUSS] KIP-459: Improve KafkaStreams#close

Thanks for digging into the back ground. I think it would be good to get feedback from people who work on clients, too. -Matthias On 5/19/19 12:58 PM, Dongjin Lee wrote: > Hi Matthias, > > I investigated the inconsistencies between `close` semantics of `Producer`, > `Consumer`, and `AdminClie

Build failed in Jenkins: kafka-trunk-jdk8 #3671

See Changes: [github] KAFKA-8371: Remove dependence on ReplicaManager from Partition (#6705) [cshapi] MINOR: Add 2.0, 2.1 and 2.2 to broker and client compat tests [github] MINOR: Update jackson to 2.9.9 (#6798

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Thanks for the KIP. I also had a look into the PR and have two follow up question: - did we consider to make the return type (ie, ArrayList, vs LinkesList) configurable or encode it the serialized bytes? - atm the size of each element is encoded individually; did we consider an optimization fo

Build failed in Jenkins: kafka-2.3-jdk8 #11

See Changes: [rhauch] KAFKA-8415: Interface ConnectorClientConfigOverridePolicy needs to be [rhauch] KAFKA-8407: Fix validation of class and list configs in connector client [ismael] MINOR: Add 2.0, 2.1 and 2.2 to

Re: [DISCUSS] KIP-439: Deprecate Interface WindowStoreIterator

Thanks John and Guozhang. I also lean towards different metric names. While updating the KIP, I also realized that the whole store API for window and session store is actually rather inconsistent. Hence, I extended the scope of this KIP to cleanup both interfaces and changed the KIP name to "

[jira] [Created] (KAFKA-8424) Replace ListGroups request/response with automated protocol

Boyang Chen created KAFKA-8424: -- Summary: Replace ListGroups request/response with automated protocol Key: KAFKA-8424 URL: https://issues.apache.org/jira/browse/KAFKA-8424 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk11 #566

See Changes: [github] KAFKA-8371: Remove dependence on ReplicaManager from Partition (#6705) [cshapi] MINOR: Add 2.0, 2.1 and 2.2 to broker and client compat tests -- [..

Build failed in Jenkins: kafka-trunk-jdk8 #3670

See Changes: [github] MINOR: Remove checking on original joined subscription within [cmccabe] KAFKA-8417: Remove redundant network definition --net=host when starting [rhauch] KAFKA-8415: Interface ConnectorCl

Re: [DISCUSS] KIP-444: Augment Metrics for Kafka Streams

Hello Patrik, Since we are rolling out 2.3 and everyone is busy with the release now this KIP does not have much discussion involved yet and will slip into the next release cadence. This KIP itself contains several parts itself: 1. refactoring the existing metrics hierarchy to cleanup some redund

[jira] [Created] (KAFKA-8423) Update ducktape to not use deprecated APIs

Matthias J. Sax created KAFKA-8423: -- Summary: Update ducktape to not use deprecated APIs Key: KAFKA-8423 URL: https://issues.apache.org/jira/browse/KAFKA-8423 Project: Kafka Issue Type: Impr

Build failed in Jenkins: kafka-2.3-jdk8 #10

See Changes: [cmccabe] KAFKA-8417: Remove redundant network definition --net=host when starting -- [...truncated 2.64 MB...] kafka.admin.DeleteTopicTest > testDeleteTopicAlre

Build failed in Jenkins: kafka-trunk-jdk11 #565

See Changes: [github] MINOR: Remove checking on original joined subscription within [cmccabe] KAFKA-8417: Remove redundant network definition --net=host when starting [rhauch] KAFKA-8415: Interface ConnectorCl

[jira] [Created] (KAFKA-8422) Client should not use old versions of OffsetsForLeaderEpoch

Jason Gustafson created KAFKA-8422: -- Summary: Client should not use old versions of OffsetsForLeaderEpoch Key: KAFKA-8422 URL: https://issues.apache.org/jira/browse/KAFKA-8422 Project: Kafka

[jira] [Resolved] (KAFKA-8093) Fix JavaDoc markup

[ https://issues.apache.org/jira/browse/KAFKA-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrik Kleindl resolved KAFKA-8093. --- Resolution: Fixed Fixed by other commits, see PR for discussion. > Fix JavaDoc markup >

[jira] [Created] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

Guozhang Wang created KAFKA-8421: Summary: Allow consumer.poll() to return data in the middle of rebalance Key: KAFKA-8421 URL: https://issues.apache.org/jira/browse/KAFKA-8421 Project: Kafka

[jira] [Resolved] (KAFKA-8371) Remove ReplicaManager dependence from Partition

[ https://issues.apache.org/jira/browse/KAFKA-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8371. Resolution: Fixed > Remove ReplicaManager dependence from Partition > -

[jira] [Created] (KAFKA-8420) Graceful handling when consumer switches from subscribe to manual assign

Guozhang Wang created KAFKA-8420: Summary: Graceful handling when consumer switches from subscribe to manual assign Key: KAFKA-8420 URL: https://issues.apache.org/jira/browse/KAFKA-8420 Project: Kafka

[jira] [Created] (KAFKA-8419) Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers

Ryan P created KAFKA-8419: - Summary: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers Key: KAFKA-8419 URL: https://issues.apache.org/jira/browse/KAFKA-8419 Project: Kafka Issue

[jira] [Resolved] (KAFKA-8407) Connector client overrides broken on client configs with type 'Class' or 'List'

[ https://issues.apache.org/jira/browse/KAFKA-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8407. -- Resolution: Fixed Reviewer: Randall Hauch Fix Version/s: 2.3.0 Merged onto the

[jira] [Resolved] (KAFKA-8415) Interface ConnectorClientConfigOverridePolicy needs to be excluded from class loading isolation

[ https://issues.apache.org/jira/browse/KAFKA-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8415. -- Resolution: Fixed Reviewer: Randall Hauch Merged onto the `trunk` and `2.3` branches. >

[jira] [Created] (KAFKA-8418) Connect System tests are not waiting for REST resources to be registered

Oleksandr Diachenko created KAFKA-8418: -- Summary: Connect System tests are not waiting for REST resources to be registered Key: KAFKA-8418 URL: https://issues.apache.org/jira/browse/KAFKA-8418 Pr

[jira] [Resolved] (KAFKA-8309) KIP-465: Add Consolidated Connector Endpoint to Connect REST API

[ https://issues.apache.org/jira/browse/KAFKA-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8309. -- Resolution: Fixed Assignee: dan norwood Reviewer: Randall Hauch Fix Ver

[jira] [Created] (KAFKA-8417) Remove redundant network definition --net=host when starting testing docker containers

Konstantine Karantasis created KAFKA-8417: - Summary: Remove redundant network definition --net=host when starting testing docker containers Key: KAFKA-8417 URL: https://issues.apache.org/jira/browse/KAFKA-

[jira] [Resolved] (KAFKA-8413) Add possibility to do repartitioning on KStream

[ https://issues.apache.org/jira/browse/KAFKA-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8413. Resolution: Not A Problem > Add possibility to do repartitioning on KStream > -

[jira] [Created] (KAFKA-8416) Improve Documentation for Enabling Optimizations

Bill Bejeck created KAFKA-8416: -- Summary: Improve Documentation for Enabling Optimizations Key: KAFKA-8416 URL: https://issues.apache.org/jira/browse/KAFKA-8416 Project: Kafka Issue Type: Improv

Re: Provide permission for creating KIP

Done. On 5/23/19 1:30 PM, omkar mestry wrote: > Hello, > > Please provide access to create KIP on confluence. My user id is omanges. > > Thanks & Regards > Omkar Mestry > signature.asc Description: OpenPGP digital signature

Re: [DISCUSSION] KIP-422: Add support for user/client configuration in the Kafka Admin Client

friendly ping... On Wed, May 15, 2019 at 10:57 AM Yaodong Yang wrote: > Hello Colin, Rajini and Jun, > > I have updated the KIP 422, please take another look! > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97555704 > > Thanks! > Yaodong > > On Tue, May 7, 2019 at 11:54 AM Y

Re: Permission to submit a new KIP

Hi , I just have permission to user id : ryan.pridgeon Thanks, On Thu, May 23, 2019 at 9:11 PM Ryan P wrote: > I would like to submit a new KIP to complete the changes made to the > KafkaLog4jAppender. Although this does enable to ability to support SASL it > does not extend to the use of SASL

Permission to submit a new KIP

I would like to submit a new KIP to complete the changes made to the KafkaLog4jAppender. Although this does enable to ability to support SASL it does not extend to the use of SASL Authentication CallbackHandlers rendering it incomplete. It's a small change however my understanding is that it will s

[jira] [Resolved] (KAFKA-7201) Optimize repartition operations

[ https://issues.apache.org/jira/browse/KAFKA-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7201. Resolution: Fixed Resolved via https://issues.apache.org/jira/browse/KAFKA-6761  > Optimize repart

[jira] [Created] (KAFKA-8415) Interface ConnectorClientConfigOverridePolicy needs to be excluded from class loading isolation

Konstantine Karantasis created KAFKA-8415: - Summary: Interface ConnectorClientConfigOverridePolicy needs to be excluded from class loading isolation Key: KAFKA-8415 URL: https://issues.apache.org/jira/brow

[jira] [Created] (KAFKA-8414) org.apache.kafka.common.metrics.MetricsTest.testConcurrentReadUpdateReport hang

dan norwood created KAFKA-8414: -- Summary: org.apache.kafka.common.metrics.MetricsTest.testConcurrentReadUpdateReport hang Key: KAFKA-8414 URL: https://issues.apache.org/jira/browse/KAFKA-8414 Project: K

[jira] [Created] (KAFKA-8413) Add possibility to do repartitioning on KStream

Levani Kokhreidze created KAFKA-8413: Summary: Add possibility to do repartitioning on KStream Key: KAFKA-8413 URL: https://issues.apache.org/jira/browse/KAFKA-8413 Project: Kafka Issue T

Re: [DISCUSS] KIP-444: Augment Metrics for Kafka Streams

Hi Guozhang Thanks for the KIP, this looks very helpful. Could you please provide more detail on the metrics planned for the state? We were just considering how to implement this ourselves because we need to track the history of stage changes. The idea was to have an accumulated "seconds in state x

Build failed in Jenkins: kafka-2.2-jdk8 #124

See Changes: [jason] KAFKA-8229; Reset WorkerSinkTask offset commit interval after task -- [...truncated 2.71 MB...] kafka.controller.PartitionLeaderElectionAlgorithmsTest >

Provide permission for creating KIP

Hello, Please provide access to create KIP on confluence. My user id is omanges. Thanks & Regards Omkar Mestry

Build failed in Jenkins: kafka-2.3-jdk8 #9

See Changes: [jason] KAFKA-8229; Reset WorkerSinkTask offset commit interval after task -- [...truncated 2.26 MB...] kafka.security.auth.SimpleAclAuthorizerTest > testAclInher

Build failed in Jenkins: kafka-trunk-jdk11 #564

See Changes: [jason] KAFKA-8229; Reset WorkerSinkTask offset commit interval after task -- [...truncated 2.46 MB...] org.apache.kafka.connect.json.JsonConverterTest > time

Build failed in Jenkins: kafka-trunk-jdk8 #3669

See Changes: [jason] KAFKA-8229; Reset WorkerSinkTask offset commit interval after task -- [...truncated 2.45 MB...] org.apache.kafka.streams.test.OutputVerifierTest > sh

[jira] [Created] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

Sebastiaan created KAFKA-8412: - Summary: Still a nullpointer exception thrown on shutdown while flushing before closing producers Key: KAFKA-8412 URL: https://issues.apache.org/jira/browse/KAFKA-8412 Proj

[jira] [Created] (KAFKA-8411) Option to keep tombstones forever in compacted logs

Lukas Welte created KAFKA-8411: -- Summary: Option to keep tombstones forever in compacted logs Key: KAFKA-8411 URL: https://issues.apache.org/jira/browse/KAFKA-8411 Project: Kafka Issue Type: Im