Build failed in Jenkins: kafka-2.4-jdk8 #124

See Changes: [matthias] KAFKA-9068: Fix javadoc of Stores.{persistent,inMemory}SessionStore -- [...truncated 2.71 MB...] org.apache.kafka.streams.TopologyTestDriverTest > s

[jira] [Created] (KAFKA-9391) The output of kafka-producer-perf-test.sh is ambiguous

jiamei xie created KAFKA-9391: - Summary: The output of kafka-producer-perf-test.sh is ambiguous Key: KAFKA-9391 URL: https://issues.apache.org/jira/browse/KAFKA-9391 Project: Kafka Issue Type: Bu

Build failed in Jenkins: kafka-2.3-jdk8 #161

See Changes: [matthias] KAFKA-9068: Fix javadoc of Stores.{persistent,inMemory}SessionStore -- [...truncated 2.98 MB...] kafka.utils.JsonTest > testLegacyEncodeAsString STAR

Build failed in Jenkins: kafka-trunk-jdk8 #4141

See Changes: [github] KAFKA-6049: extend Kafka Streams Scala API for cogroup (KIP-150) (#7847) [jason] KAFKA-8988; Replace CreatePartitions Request/Response with automated

[jira] [Resolved] (KAFKA-9264) Reocurrence: Flaky Test DelegationTokenEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

[ https://issues.apache.org/jira/browse/KAFKA-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9264. --- Fix Version/s: 2.4.0 Resolution: Duplicate > Reocurrence: Flaky Test > DelegationToke

[jira] [Resolved] (KAFKA-9187) kafka.api.SaslGssapiSslEndToEndAuthorizationTest.testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

[ https://issues.apache.org/jira/browse/KAFKA-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9187. --- Fix Version/s: 2.4.0 Resolution: Duplicate > kafka.api.SaslGssapiSslEndToEndAuthorizat

Re: [VOTE] KIP-373: Allow users to create delegation tokens for other users

Bumping this in the hope of a vote or additional feedback. Viktor On Tue, Dec 3, 2019 at 1:07 PM Viktor Somogyi-Vass wrote: > Hi Folks, > > I'd like to bump this once more in the hope of a binding vote or any > additional feedback. > > Thanks, > Viktor > > On Fri, Oct 25, 2019 at 2:24 PM Viktor

[jira] [Created] (KAFKA-9392) Document and add test for deleteAcls that match single/multiple resources

Rajini Sivaram created KAFKA-9392: - Summary: Document and add test for deleteAcls that match single/multiple resources Key: KAFKA-9392 URL: https://issues.apache.org/jira/browse/KAFKA-9392 Project: Ka

Jenkins build is back to normal : kafka-trunk-jdk8 #4142

See

[jira] [Resolved] (KAFKA-9379) Flaky Test TopicCommandWithAdminClientTest.testCreateAlterTopicWithRackAware

[ https://issues.apache.org/jira/browse/KAFKA-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9379. --- Fix Version/s: 2.5.0 Reviewer: Ismael Juma Resolution: Fixed > Flaky Test Top

[jira] [Resolved] (KAFKA-9386) Flaky test AclAuthorizerTest.testHighConcurrencyDeletionOfResourceAcls

[ https://issues.apache.org/jira/browse/KAFKA-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9386. --- Reviewer: Manikumar Resolution: Fixed > Flaky test AclAuthorizerTest.testHighConcurrenc

[jira] [Resolved] (KAFKA-8786) Deprecated Gradle features making it incompatible with Gradle 6.0.

[ https://issues.apache.org/jira/browse/KAFKA-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-8786. Fix Version/s: 2.5.0 Resolution: Fixed > Deprecated Gradle features making it incompatible w

Build failed in Jenkins: kafka-trunk-jdk11 #1063

See Changes: [github] KAFKA-9379; Fix flaky test -- [...truncated 2.80 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest > shouldRequireCustomTopicNameIfN

[jira] [Created] (KAFKA-9393) DeleteRecords triggers extreme lock contention for large partition directories

Lucas Bradstreet created KAFKA-9393: --- Summary: DeleteRecords triggers extreme lock contention for large partition directories Key: KAFKA-9393 URL: https://issues.apache.org/jira/browse/KAFKA-9393 Pr

Build failed in Jenkins: kafka-trunk-jdk8 #4143

See Changes: [github] KAFKA-9379; Fix flaky test [github] KAFKA-9386; Apply delete ACL filters to resources from filter even if -- [...truncated 2.78 MB...] org.apache.

A Grammar for the Kafka Streams DSL

Hello all, After many smaller-scope discussions about how to format the objects and methods in the Streams DSL, it seems like the time is long past due to establish a definition of the language. I've drafted a grammar that I think will greatly improve the ergonomics of the DSL, as well as make

[jira] [Resolved] (KAFKA-9383) Expose Consumer Group Metadata for Transactional Producer

[ https://issues.apache.org/jira/browse/KAFKA-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9383. Fix Version/s: 2.5.0 Resolution: Fixed > Expose Consumer Group Metadata for Transact

[jira] [Created] (KAFKA-9394) Add partial success for Consumer offset fetch

Boyang Chen created KAFKA-9394: -- Summary: Add partial success for Consumer offset fetch Key: KAFKA-9394 URL: https://issues.apache.org/jira/browse/KAFKA-9394 Project: Kafka Issue Type: Improveme

[jira] [Created] (KAFKA-9395) Improve Kafka scheduler's periodic maybeShrinkIsr()

Brian Byrne created KAFKA-9395: -- Summary: Improve Kafka scheduler's periodic maybeShrinkIsr() Key: KAFKA-9395 URL: https://issues.apache.org/jira/browse/KAFKA-9395 Project: Kafka Issue Type: Imp

[jira] [Resolved] (KAFKA-9287) Transaction completion may block unnecessarily after abortable error

[ https://issues.apache.org/jira/browse/KAFKA-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9287. Fix Version/s: 2.5.0 Resolution: Fixed > Transaction completion may block unnecessar

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

+1 on merging `StreamsNotRunningException` and `StateStoreNotAvailableException`, both exceptions are fatal anyway. IMO its best to have these exceptions be about the state store (and not streams state), to easier understanding. Additionally, KIP-535 allows for querying of state stores in reba

Build failed in Jenkins: kafka-trunk-jdk8 #4144

See Changes: [matthias] KAFKA-9383: Expose consumer group metadata (#7906) -- [...truncated 2.78 MB...] org.apache.kafka.streams.MockTimeTest > shouldSetStartTime STARTED

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

Good question about `StreamsRebalancingException` -- when this KIP was started, KIP-535 was not on the horizon yet. What I am wondering is, if we should allow people to opt-in into querying during a rebalance, or to be more precise during a restore (if a state store is not migrated, it will be up-

Jenkins build is back to normal : kafka-trunk-jdk11 #1064

See

Build failed in Jenkins: kafka-trunk-jdk8 #4145

See Changes: [github] KAFKA-9287; Fix unneeded delay before failing pending transaction commit -- [...truncated 2.79 MB...] org.apache.kafka.streams.TopologyTestDriverT

[jira] [Resolved] (KAFKA-9144) Early expiration of producer state can cause coordinator epoch to regress

[ https://issues.apache.org/jira/browse/KAFKA-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9144. Fix Version/s: 2.4.1 Resolution: Fixed > Early expiration of producer state can caus

[jira] [Resolved] (KAFKA-8242) Exception in ReplicaFetcher blocks replication of all other partitions

[ https://issues.apache.org/jira/browse/KAFKA-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8242. Resolution: Fixed Marking this as resolved. We believe we having fixed the cause of the co

[jira] [Resolved] (KAFKA-8179) Incremental Rebalance Protocol for Kafka Consumer

[ https://issues.apache.org/jira/browse/KAFKA-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8179. -- Fix Version/s: 2.4.0 2.5.0 Resolution: Fixed > Incremental Rebalance

[jira] [Resolved] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8421. -- Fix Version/s: 2.5.0 Assignee: Guozhang Wang Resolution: Fixed > Allow consumer

[DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

Hi all, I wrote KIP about deprecating the --zookeeper flag in the administrative tools. Take a look if you get a chance: https://cwiki.apache.org/confluence/x/sotSC best, Colin

[jira] [Created] (KAFKA-9397) Deprecate Direct Zookeeper access in Kafka Administrative Tools

Colin McCabe created KAFKA-9397: --- Summary: Deprecate Direct Zookeeper access in Kafka Administrative Tools Key: KAFKA-9397 URL: https://issues.apache.org/jira/browse/KAFKA-9397 Project: Kafka

Re: [DISCUSS] KIP-551: Expose disk read and write metrics

Hi Colin, This is a great idea, as it is very useful to have these metrics in addition to the usual Kafka metrics given the impact of hitting disk outside of page cache. Describing it as a gauge did initially strike me as oldd, but given the way this is works it makes sense to me. /proc/[pid]/io

Re: [DISCUSS] KIP-551: Expose disk read and write metrics

Thanks Colin, LGTM in general. The Linux documentation ( https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/filesystems/proc.txt?id=HEAD#n1644) defines these metrics as read_bytes > -- > > I/O counter: bytes read > Attempt to count the number of bytes wh

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

Thanks Colin, For the tools that only support zookeeper (zookeeper-security-migration.sh and zookeeper-shell.sh) should we be deprecating the entire tool for removal in a future 3.0 release? On Thu, Jan 9, 2020 at 4:24 PM Colin McCabe wrote: > Hi all, > > I wrote KIP about deprecating the --zoo

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

I think you linked to the wrong KIP? Here's a link that worked for me: https://s.apache.org/ve15g On Thu, Jan 9, 2020 at 4:24 PM Colin McCabe wrote: > > Hi all, > > I wrote KIP about deprecating the --zookeeper flag in the administrative > tools. Take a look if you get a chance: > > https://cwi

Re: [DISCUSS] KIP-551: Expose disk read and write metrics

On Thu, Jan 9, 2020, at 16:34, Lucas Bradstreet wrote: > Hi Colin, > > This is a great idea, as it is very useful to have these metrics in > addition to the usual Kafka metrics given the impact of hitting disk > outside of page cache. Describing it as a gauge did initially strike me as > oldd, but

Re: [DISCUSS] KIP-551: Expose disk read and write metrics

On Thu, Jan 9, 2020, at 16:39, Jose Garcia Sancio wrote: > Thanks Colin, > > LGTM in general. The Linux documentation ( > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/filesystems/proc.txt?id=HEAD#n1644) > defines these metrics as > > read_bytes > > ---

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

On Thu, Jan 9, 2020, at 16:46, Gwen Shapira wrote: > I think you linked to the wrong KIP? Here's a link that worked for me: > https://s.apache.org/ve15g Oops! Thanks for the correction. That is indeed the right link. Colin > > On Thu, Jan 9, 2020 at 4:24 PM Colin McCabe wrote: > > > > Hi all

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

That's a good question. The current plan is for the 3.x releases to still require ZooKeeper. What we will drop in 3.x is direct ZK access in command-line administrative tools (unless those tools are specifically about administering ZK itself, like launching it, stopping it, editing its interna

[jira] [Resolved] (KAFKA-8617) Replace EndTxn request/response with automated protocol

[ https://issues.apache.org/jira/browse/KAFKA-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8617. Fix Version/s: 2.5.0 Resolution: Fixed > Replace EndTxn request/response with automa

Jenkins build is back to normal : kafka-trunk-jdk8 #4146

See

Build failed in Jenkins: kafka-trunk-jdk11 #1066

See Changes: [github] KAFKA-9144; Track timestamp from txn markers to prevent early producer [github] KAFKA-9294: Add tests for Named parameter (#7874) [github] KAFKA-8421: Still return data during rebalance (

Build failed in Jenkins: kafka-trunk-jdk11 #1067

See Changes: -- Started by an SCM change Started by an SCM change Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H23

Build failed in Jenkins: kafka-trunk-jdk11 #1068

See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu) in workspace

Build failed in Jenkins: kafka-2.4-jdk8 #125

See Changes: [jason] KAFKA-9144; Track timestamp from txn markers to prevent early producer -- [...truncated 5.50 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-9385) Connect cluster: connector task repeat like a splitbrain cluster problem

[ https://issues.apache.org/jira/browse/KAFKA-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kaikai.hou resolved KAFKA-9385. --- Resolution: Duplicate > Connect cluster: connector task repeat like a splitbrain cluster problem > -