[jira] [Created] (KAFKA-9036) Allow kafka auth acls with match pattern

Pradeep Bansal created KAFKA-9036: - Summary: Allow kafka auth acls with match pattern Key: KAFKA-9036 URL: https://issues.apache.org/jira/browse/KAFKA-9036 Project: Kafka Issue Type: Improvem

Re: [VOTE] KIP-511: Collect and Expose Client's Name and Version in the Brokers

Hi all, Jun, The new fields are not flexible fields while the request and response are flexible versions. It does not cost us because the version of the request is bumped anyway to enable the flexible versions. The rationale behind this choice is that it forces the clients to provide the informati

[Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Hello Dev Community, I have been trying to setup Kafka in Intellij. When i try to run Kafka class in core package. it takes infinite time. It keeps loading. I want to pick up some newbie Kafka issues and work on them but this setup is not working for me. If anyone can help me setting up kafka p

[jira] [Created] (KAFKA-9037) Java Out Of Memory(OOM) error encountered while deleting Kafka records using SASL designated port.

Akshath Karanam created KAFKA-9037: -- Summary: Java Out Of Memory(OOM) error encountered while deleting Kafka records using SASL designated port. Key: KAFKA-9037 URL: https://issues.apache.org/jira/browse/KAFKA-90

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

https://medium.com/@manasvi/getting-started-with-contributing-to-apache-kafka-part-1-build-and-run-kafka-from-source-code-f900452fdc06 I wrote this blog post sometime ago for folks to get started with contributing to Apache Kafka. I am behind of part 2 of the post, hopefully will be done in few d

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Manasavi, I have followed your blog but I am getting no logs in IDE. I am seeing Kafka.main running infinitely with logging anything in IDE console. I have attached an image for your reference. On Mon, Oct 14, 2019 at 4:56 PM Manasvi Gupta wrote: > > https://medium.com/@manasvi/getting-started

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Can you try copying config/log4j.properties to core/src/main/resources/log4j.properties and see if it helps? On Mon 14 Oct, 2019, 5:01 PM chandresh pancholi, < chandreshpancholi...@gmail.com> wrote: > Manasavi, > > I have followed your blog but I am getting no logs in IDE. I am seeing > Kafka.mai

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Sadly, No luck !! [image: Screenshot 2019-10-14 at 5.52.55 PM.png] On Mon, Oct 14, 2019 at 5:22 PM Manasvi Gupta wrote: > Can you try copying config/log4j.properties to > core/src/main/resources/log4j.properties and see if it helps? > > On Mon 14 Oct, 2019, 5:01 PM chandresh pancholi, < > chand

[DISCUSS] KIP-536: Propagate broker timestamp to Admin API

We are in the process of migrating the pieces of automation that currently reads and modifies zookeeper state to use the Admin API. One of the things that we miss doing this is access to the start time of brokers in a cluster which is used by our automation doing rolling restarts. We currently

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Let me rephrase it. I figured out that Kafka is running successfully but i can't see logs in IntelliJ console. To see the logs do i have to change any properties. On Mon, Oct 14, 2019 at 5:53 PM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Sadly, No luck !! > > [image: Screensho

Re: [VOTE] KIP-511: Collect and Expose Client's Name and Version in the Brokers

+1 On Mon, Oct 14, 2019 at 3:47 PM David Jacot wrote: > Hi all, > > Jun, > The new fields are not flexible fields while the request and response are > flexible versions. It does not cost us because the version of the request > is bumped anyway to enable the flexible versions. The rationale behin

Re: [DISCUSS] KIP-515: Reorganize checkpoint system in log cleaner to be per partition

The sentence ` (KAFKA-4545 ) ` could be change to `KAFKA-4545 < https://issues.apache.org/jira/browse/KAFKA-4545 >` ? On Sun, Oct 13, 2019 at 2:08 AM Richard Yu wrote: > Hi Jun, Jason, > > I've updated the

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

yes, you need to add log4j to jvm option -Dlog4j.configuration=file:/path/to/log4j.properties On Mon, Oct 14, 2019 at 10:33 PM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Let me rephrase it. > > I figured out that Kafka is running successfully but i can't see logs in > IntelliJ

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

I have given full path in VM options *-Dlog4j.configuration=file:/Users/Chandresh/opensource/kafka/config/log4j.properties* still no logs in console. [image: Screenshot 2019-10-14 at 8.44.34 PM.png] On Mon, Oct 14, 2019 at 8:16 PM tao xiao wrote: > yes, you need to add log4j to jvm option > >

Re: [VOTE] 2.3.1 RC1

David, Why do we have two site-doc packages, one for each Scala version? It is just HTML, right? IIRC, in previous releases we only packaged the docs once? Gwen On Fri, Oct 4, 2019 at 6:52 PM David Arthur wrote: > > Hello all, we identified a few bugs and a dependency update we wanted to > get

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Wondering if below exception is anywhere related SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. SLF4J: Failed to load class "org.slf4j.

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

one more thing you need to do is to include slf4j-log4j in build.gradle as it is not included as compiled by default On Tue, Oct 15, 2019 at 12:21 AM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Wondering if below exception is anywhere related > > SLF4J: Failed to load class "org

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Thanks Tao Xiao, It worked. On Mon, Oct 14, 2019 at 9:55 PM tao xiao wrote: > one more thing you need to do is to include slf4j-log4j in build.gradle as > it is not included as compiled by default > > On Tue, Oct 15, 2019 at 12:21 AM chandresh pancholi < > chandreshpancholi...@gmail.com> wrote:

[jira] [Created] (KAFKA-9038) Allow creating partitions while partition reassignment is in progress

Bob Barrett created KAFKA-9038: -- Summary: Allow creating partitions while partition reassignment is in progress Key: KAFKA-9038 URL: https://issues.apache.org/jira/browse/KAFKA-9038 Project: Kafka

Re: [DISCUSS] KIP-535: Allow state stores to serve stale reads during rebalance

Hi Navinder, Thanks for sharing the KIP! Few thoughts - Can we link the JIRA, discussion thread also to the KIP - Based on the discussion on KAFKA-6144, I was under the impression that this KIP is also going to cover exposing of the standby information in StreamsMetadata and thus subsume KAFKA-89

[jira] [Created] (KAFKA-9039) Optimize replica fetching CPU utilization with large number of partitions

Guozhang Wang created KAFKA-9039: Summary: Optimize replica fetching CPU utilization with large number of partitions Key: KAFKA-9039 URL: https://issues.apache.org/jira/browse/KAFKA-9039 Project: Kafk

Re: [VOTE] 2.3.1 RC1

Hi David, Probably not a blocker, but I noticed the authorization section in the security docs was not updated in 2.3.0 to include authorization details for ElectPreferredLeaders and IncrementalAlterConfigs. I just opened a PR to address that in 2.3: https://github.com/apache/kafka/pull/7508 (and

Re: [DISCUSS] KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils

Hi, After some investigations, I updated the KIP and the sample MR again: 1. Move the Mocks under test-utils/state 2. extends a WrappedStateStore<>. The reason is that since we decided to provide the testing capability to wrap around a store the developer provides, WrappedStateStore seems the way

Re: KAFKA-8104: Help with the review

Hello. I got very helpfull advices from guozhang. And now, we have a ready fix and reproducer. This PR fixes a very long living Kafka Consumer bug. Please, join to the review. [1] https://issues.apache.org/jira/browse/KAFKA-8104 [2] https://github.com/apache/kafka/pull/7460 В Пн, 07/10/2019 в 2

[jira] [Resolved] (KAFKA-9020) Streams sub-topologies should be sorted by sink -> source relationship

[ https://issues.apache.org/jira/browse/KAFKA-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9020. Fix Version/s: 2.4.0 Resolution: Fixed > Streams sub-topologies should be so

Re: KAFKA-8104: Help with the review

Hello Nikolay, I'm still on your PR, but was swamped with some other issues as the release code freeze date's approaching, will try to make another pass on it asap. Guozhang On Mon, Oct 14, 2019 at 12:46 PM Nikolay Izhikov wrote: > Hello. > > I got very helpfull advices from guozhang. > And n

[DISCUSS] KIP-150 - Kafka-Streams Cogroup

Hello all, I have picked up and updated KIP-150. Due to changes to the project since KIP #150 was written there are a few items that need to be updated. First item that changed is the adoption of the Materialized parameter. The second item is the WindowedBy. How the old KIP handles windowing is

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

https://cwiki.apache.org/confluence/display/KAFKA/KIP-150+-+Kafka-Streams+Cogroup here is a link On Mon, Oct 14, 2019 at 2:52 PM Walker Carlson wrote: > Hello all, > > I have picked up and updated KIP-150. Due to changes to the project since > KIP #150 was written there are a few items that need

Build failed in Jenkins: kafka-trunk-jdk8 #3968

See Changes: [bbejeck] delete (#7504) -- [...truncated 5.42 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldProcessConsumerRecordList[Eos enabled = false

Jenkins build is back to normal : kafka-trunk-jdk11 #880

See

[VOTE] KIP-534: Retain tombstones for approximately delete.retention.ms milliseconds

Hi all, The discussion for KIP-534 seems to have concluded. So I wish to vote this in so that we can get it done. Its a small bug fix. :) Below is the KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-534%3A+Retain+tombstones+for+approximately+delete.retention.ms+milliseconds Cheer

Build failed in Jenkins: kafka-2.4-jdk8 #12

See Changes: [bill] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source -- [...truncated 2.67 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shou

Re: [VOTE] KIP-534: Retain tombstones for approximately delete.retention.ms milliseconds

Hi, Richard, Thanks for the KIP. Looks good to me overall. A few minor comments below. 1. Could you change the title from "Retain tombstones" to "Retain tombstones and transaction markers" to make it more general? 2. Could you document which bit in the batch attribute will be used for the new fl

[jira] [Created] (KAFKA-9040) Implement --all option when describing configs

Jason Gustafson created KAFKA-9040: -- Summary: Implement --all option when describing configs Key: KAFKA-9040 URL: https://issues.apache.org/jira/browse/KAFKA-9040 Project: Kafka Issue Type:

Build failed in Jenkins: kafka-trunk-jdk11 #881

See Changes: [wangguoz] MINOR: move "Added/Removed sensor" log messages to TRACE (#7502) [bbejeck] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source [matthias] MINOR: clarify wording around

Re: KAFKA-8104: Help with the review

Hello, Guozhang. Got it, thanks for the help with the PR. Will wait for your review. В Пн, 14/10/2019 в 13:40 -0700, Guozhang Wang пишет: > Hello Nikolay, > > I'm still on your PR, but was swamped with some other issues as the release > code freeze date's approaching, will try to make another pa

Jenkins build is back to normal : kafka-2.3-jdk8 #124

See

[jira] [Resolved] (KAFKA-9006) Flaky Test KTableKTableForeignKeyJoinIntegrationTest.doLeftJoinFilterOutRapidlyChangingForeignKeyValues

[ https://issues.apache.org/jira/browse/KAFKA-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-9006. - Resolution: Duplicate > Flaky Test > KTableKTableForeignKeyJoinIntegrationTest.doLeftJoinFilterO

[jira] [Created] (KAFKA-9041) Flaky Test LogCleanerIntegrationTest#testIsThreadFailed

Matthias J. Sax created KAFKA-9041: -- Summary: Flaky Test LogCleanerIntegrationTest#testIsThreadFailed Key: KAFKA-9041 URL: https://issues.apache.org/jira/browse/KAFKA-9041 Project: Kafka Iss

[jira] [Resolved] (KAFKA-8460) Flaky Test PlaintextConsumerTest#testLowMaxFetchSizeForRequestAndPartition

[ https://issues.apache.org/jira/browse/KAFKA-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8460. Resolution: Duplicate > Flaky Test PlaintextConsumerTest#testLowMaxFetchSizeForRequestAndP

Build failed in Jenkins: kafka-trunk-jdk8 #3969

See Changes: [wangguoz] MINOR: move "Added/Removed sensor" log messages to TRACE (#7502) [bbejeck] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source [matthias] MINOR: clarify wording around

[jira] [Created] (KAFKA-9042) Auto infer external topic partitions in stream reset tool

Boyang Chen created KAFKA-9042: -- Summary: Auto infer external topic partitions in stream reset tool Key: KAFKA-9042 URL: https://issues.apache.org/jira/browse/KAFKA-9042 Project: Kafka Issue Typ

Build failed in Jenkins: kafka-2.4-jdk8 #13

See Changes: [matthias] MINOR: clarify wording around fault-tolerant state stores (#7510) -- [...truncated 4.90 MB...] kafka.api.SaslSslAdminClientIntegrationTest > testLis

[jira] [Created] (KAFKA-9043) Problem committing offsets when using consumer subscribe and assign method on different topics with same group.id

Michael Arndt created KAFKA-9043: Summary: Problem committing offsets when using consumer subscribe and assign method on different topics with same group.id Key: KAFKA-9043 URL: https://issues.apache.org/jira/brow