[jira] [Created] (KAFKA-8023) Improve global state store restoration by using multiple update threads

Patrik Kleindl created KAFKA-8023: - Summary: Improve global state store restoration by using multiple update threads Key: KAFKA-8023 URL: https://issues.apache.org/jira/browse/KAFKA-8023 Project: Kafk

[jira] [Created] (KAFKA-8024) UtilsTest.testFormatBytes fails with german locale

Patrik Kleindl created KAFKA-8024: - Summary: UtilsTest.testFormatBytes fails with german locale Key: KAFKA-8024 URL: https://issues.apache.org/jira/browse/KAFKA-8024 Project: Kafka Issue Type

Build failed in Jenkins: kafka-2.2-jdk8 #40

See Changes: [jason] KAFKA-8012; Ensure partitionStates have not been removed before -- [...truncated 2.69 MB...] kafka.controller.PartitionLeaderElectionAlgorithmsTest > tes

Jenkins build is back to normal : kafka-2.1-jdk8 #139

See

Re: [DISCUSS] KIP-430 - Return Authorized Operations in Describe Responses

Hi all, KIP-430 proposed an new method to the Scala `Authorizer` trait with a default implementation so that existing implementations continue to work. But Scala 2.11 doesn't convert the default implementation in a trait to a default implementation in Java. So this breaks existing Java authorizer

[jira] [Created] (KAFKA-8025) Flaky Test RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest#shouldForwardAllDbOptionsCalls

Konstantine Karantasis created KAFKA-8025: - Summary: Flaky Test RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest#shouldForwardAllDbOptionsCalls Key: KAFKA-8025 URL: https://issues.apache.org/

[jira] [Created] (KAFKA-8026) Flaky Test RegexSourceIntegrationTest#testRegexMatchesTopicsAWhenDeleted

Matthias J. Sax created KAFKA-8026: -- Summary: Flaky Test RegexSourceIntegrationTest#testRegexMatchesTopicsAWhenDeleted Key: KAFKA-8026 URL: https://issues.apache.org/jira/browse/KAFKA-8026 Project: K

[jira] [Resolved] (KAFKA-7918) Streams store cleanup: inline byte-store generic parameters

[ https://issues.apache.org/jira/browse/KAFKA-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-7918. Resolution: Fixed > Streams store cleanup: inline byte-store generic parameters > -

Re: [DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

Thanks Randall. I like your suggestion: as you say, this would make it possible to usefully override the default client id properties. I'm not sure how we would handle the dead-letter queue case though - maybe we could automatically add a "dlq-" prefix to the producer client id? If there is agre

[jira] [Created] (KAFKA-8027) Gradual decline in performance of CachingWindowStore provider when number of keys grow

Prashant created KAFKA-8027: --- Summary: Gradual decline in performance of CachingWindowStore provider when number of keys grow Key: KAFKA-8027 URL: https://issues.apache.org/jira/browse/KAFKA-8027 Project: K

Jenkins build is back to normal : kafka-trunk-jdk11 #330

See

Re: [DISCUSS] KIP-433: Provide client API version to authorizer

On Wed, Feb 27, 2019, at 15:53, Harsha wrote: > HI Colin, > Overlooked the IDEMPOTENT_WRITE ACL. This along with > client.min.version should solve the cases proposed in the KIP. > Can we turn this KIP into adding min.client.version config to broker > and it could be part of the dynami

Re: [DISCUSS] KIP-426: Persist Broker Id to Zookeeper

On Wed, Feb 27, 2019, at 14:12, Harsha wrote: > Hi Colin, > What we want to is to preserve the broker.id so that we > can do an offline rebuild of a broker. In our cases going through > online Kafka replication to bring up, a failed node will put producer > latencies at risk given

[jira] [Resolved] (KAFKA-7912) In-memory key-value store does not support concurrent access

[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-7912. Resolution: Fixed > In-memory key-value store does not support concurrent access >

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

Hi Jun, Could you help review KIP-236 when you have time?  Thanks. Hi Becket,  Since you filed https://issues.apache.org/jira/browse/KAFKA-6304 to request this feature.  Could you also help review and comment on KIP-236 ?  Thanks.  Hi Viktor, I have updated https://github.com/apache/kafka/pu

[VOTE] 2.2.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 2.2.0. - Added SSL support for custom principle name - Allow SASL connections to periodically re-authenticate - Improved consumer group management - default group.id is `null` inste

Re: [VOTE] 2.2.0 RC1

Hi Matthias, The Confluence release page is correct, but the “ - Add --under-min-isr option to describe topics command” was pushed back to 2.3.0. Thanks, Kevin On Fri, Mar 1, 2019 at 11:48 AM Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second c

Error deserializing Avro message for id 25

Hello I am seeing the following error in the log when consume the AVRO message, try to google it, no help, could anyone explain what the error means in here? Thanks Raymond 2019-02-27 01:37:35,135 ERROR [stderr] (default task-24) org.apache.kafka.common.errors.SerializationException: Error des

Re: Apache Kafka Memory Leakage???

Hi Syed, from your screenshot I assume that you are using SnapLogic to run your code (full disclosure: I do not have the faintest idea of this product!). I've just had a look at the docs and am a bit confused by their explanation of the metric that you point out in your image "Memory Allocated". T

Re: [DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

Paul, Randall, I don't think most people will care to exercise so much control over the client IDs, so long as they are filled in automatically in a way that eliminates duplicate metrics and remains somewhat legible. If we let the user specify a pattern or something, we're really just making the us

[jira] [Created] (KAFKA-8028) Kafka - ACL remove

Sathish Yanamala created KAFKA-8028: --- Summary: Kafka - ACL remove Key: KAFKA-8028 URL: https://issues.apache.org/jira/browse/KAFKA-8028 Project: Kafka Issue Type: Task Reporter

[jira] [Reopened] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

[ https://issues.apache.org/jira/browse/KAFKA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-7221: > Add Build method to StreamsBuilder accepting Properties > --

[jira] [Reopened] (KAFKA-3770) KStream job should be able to specify linger.ms

[ https://issues.apache.org/jira/browse/KAFKA-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3770: > KStream job should be able to specify linger.ms > ---

[jira] [Reopened] (KAFKA-7419) Rolling sum for high frequency sream

[ https://issues.apache.org/jira/browse/KAFKA-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-7419: > Rolling sum for high frequency sream > > >

[jira] [Resolved] (KAFKA-7419) Rolling sum for high frequency sream

[ https://issues.apache.org/jira/browse/KAFKA-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7419. Resolution: Not A Problem > Rolling sum for high frequency sream >

[jira] [Resolved] (KAFKA-3770) KStream job should be able to specify linger.ms

[ https://issues.apache.org/jira/browse/KAFKA-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3770. Resolution: Duplicate > KStream job should be able to specify linger.ms > -

[jira] [Reopened] (KAFKA-6592) NullPointerException thrown when executing ConsoleCosumer with deserializer set to `WindowedDeserializer`

[ https://issues.apache.org/jira/browse/KAFKA-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-6592: > NullPointerException thrown when executing ConsoleCosumer with deserializer > set to `Window

[jira] [Reopened] (KAFKA-6092) Time passed in punctuate call is currentTime, not punctuate schedule time.

[ https://issues.apache.org/jira/browse/KAFKA-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-6092: > Time passed in punctuate call is currentTime, not punctuate schedule time. > ---

[jira] [Resolved] (KAFKA-6092) Time passed in punctuate call is currentTime, not punctuate schedule time.

[ https://issues.apache.org/jira/browse/KAFKA-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6092. Resolution: Not A Problem > Time passed in punctuate call is currentTime, not punctuate sch

[jira] [Reopened] (KAFKA-5825) Streams not processing when exactly once is set

[ https://issues.apache.org/jira/browse/KAFKA-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5825: > Streams not processing when exactly once is set > ---

[jira] [Resolved] (KAFKA-5825) Streams not processing when exactly once is set

[ https://issues.apache.org/jira/browse/KAFKA-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5825. Resolution: Not A Bug > Streams not processing when exactly once is set > -

[jira] [Resolved] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

[ https://issues.apache.org/jira/browse/KAFKA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7221. Resolution: Duplicate > Add Build method to StreamsBuilder accepting Properties >

Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

Hello Boyang, I've just made a quick pass on the KIP and here are some thoughts. Meta: 1. I'm still not sure if it's worthwhile to add a new type of "learner task" in addition to "standby task": if the only difference is that for the latter, we would consider workload balance while for the forme

[jira] [Resolved] (KAFKA-5551) StreamThread should not expose methods for testing

[ https://issues.apache.org/jira/browse/KAFKA-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5551. Resolution: Duplicate > StreamThread should not expose methods for testing > --

[jira] [Reopened] (KAFKA-5551) StreamThread should not expose methods for testing

[ https://issues.apache.org/jira/browse/KAFKA-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5551: > StreamThread should not expose methods for testing >

[jira] [Resolved] (KAFKA-7628) KafkaStream is not closing

[ https://issues.apache.org/jira/browse/KAFKA-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7628. -- Resolution: Not A Problem > KafkaStream is not closing > -- > >

[jira] [Reopened] (KAFKA-7628) KafkaStream is not closing

[ https://issues.apache.org/jira/browse/KAFKA-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-7628: -- > KafkaStream is not closing > -- > > Key: KAFKA-7628 >

[jira] [Resolved] (KAFKA-6592) NullPointerException thrown when executing ConsoleCosumer with deserializer set to `WindowedDeserializer`

[ https://issues.apache.org/jira/browse/KAFKA-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6592. Resolution: Duplicate > NullPointerException thrown when executing ConsoleCosumer with dese

Build failed in Jenkins: kafka-trunk-jdk8 #3429

See Changes: [wangguoz] MINOR: ConsumerNetworkClient does not need to send the remaining [wangguoz] HOTFIX: add igore import to streams_upgrade_test -- [...truncated 2.31

Build failed in Jenkins: kafka-1.1-jdk7 #250

See Changes: [wangguoz] HOTFIX: add igore import to streams_upgrade_test -- [...truncated 1.94 MB...] org.apache.kafka.streams.StreamsConfigTest > shouldNotOverrideUserConfi

[jira] [Resolved] (KAFKA-4953) Global Store: cast exception when initialising with in-memory logged state store

[ https://issues.apache.org/jira/browse/KAFKA-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4953. Resolution: Duplicate > Global Store: cast exception when initialising with in-memory logge

[jira] [Reopened] (KAFKA-4953) Global Store: cast exception when initialising with in-memory logged state store

[ https://issues.apache.org/jira/browse/KAFKA-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4953: > Global Store: cast exception when initialising with in-memory logged state > store > ---

[jira] [Resolved] (KAFKA-4732) Unstable test: KStreamKTableJoinIntegrationTest.shouldCountClicksPerRegion[1]

[ https://issues.apache.org/jira/browse/KAFKA-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4732. Resolution: Duplicate > Unstable test: KStreamKTableJoinIntegrationTest.shouldCountClicksPe

[jira] [Reopened] (KAFKA-4721) KafkaStreams (and possibly others) should inherit Closeable

[ https://issues.apache.org/jira/browse/KAFKA-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4721: > KafkaStreams (and possibly others) should inherit Closeable > ---

[jira] [Reopened] (KAFKA-4732) Unstable test: KStreamKTableJoinIntegrationTest.shouldCountClicksPerRegion[1]

[ https://issues.apache.org/jira/browse/KAFKA-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4732: > Unstable test: KStreamKTableJoinIntegrationTest.shouldCountClicksPerRegion[1] > -

[jira] [Reopened] (KAFKA-5063) Flaky ResetIntegrationTest.testReprocessingFromScratchAfterResetWithIntermediateUserTopic

[ https://issues.apache.org/jira/browse/KAFKA-5063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5063: > Flaky > ResetIntegrationTest.testReprocessingFromScratchAfterResetWithIntermediateUserTopic

[jira] [Resolved] (KAFKA-5063) Flaky ResetIntegrationTest.testReprocessingFromScratchAfterResetWithIntermediateUserTopic

[ https://issues.apache.org/jira/browse/KAFKA-5063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5063. Resolution: Cannot Reproduce > Flaky > ResetIntegrationTest.testReprocessingFromScratchAft

[jira] [Reopened] (KAFKA-4186) Transient failure in KStreamAggregationIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4186: > Transient failure in KStreamAggregationIntegrationTest >

[jira] [Reopened] (KAFKA-4281) Should be able to forward aggregation values immediately

[ https://issues.apache.org/jira/browse/KAFKA-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4281: > Should be able to forward aggregation values immediately > --

[jira] [Resolved] (KAFKA-4186) Transient failure in KStreamAggregationIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4186. Resolution: Cannot Reproduce > Transient failure in KStreamAggregationIntegrationTest > ---

[jira] [Resolved] (KAFKA-4281) Should be able to forward aggregation values immediately

[ https://issues.apache.org/jira/browse/KAFKA-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4281. Resolution: Duplicate > Should be able to forward aggregation values immediately >

[jira] [Reopened] (KAFKA-3826) Sampling on throughput / latency metrics recording in Streams

[ https://issues.apache.org/jira/browse/KAFKA-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3826: > Sampling on throughput / latency metrics recording in Streams > -

[jira] [Resolved] (KAFKA-3826) Sampling on throughput / latency metrics recording in Streams

[ https://issues.apache.org/jira/browse/KAFKA-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3826. Resolution: Duplicate > Sampling on throughput / latency metrics recording in Streams > ---

[jira] [Resolved] (KAFKA-3884) KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging

[ https://issues.apache.org/jira/browse/KAFKA-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3884. Resolution: Duplicate > KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging >

[jira] [Resolved] (KAFKA-4849) Bug in KafkaStreams documentation

[ https://issues.apache.org/jira/browse/KAFKA-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4849. Resolution: Duplicate (was: Fixed) > Bug in KafkaStreams documentation > -

[jira] [Resolved] (KAFKA-4721) KafkaStreams (and possibly others) should inherit Closeable

[ https://issues.apache.org/jira/browse/KAFKA-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4721. Resolution: Duplicate > KafkaStreams (and possibly others) should inherit Closeable > -

[jira] [Reopened] (KAFKA-5122) Kafka Streams unexpected off-heap memory growth

[ https://issues.apache.org/jira/browse/KAFKA-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-5122: -- > Kafka Streams unexpected off-heap memory growth > ---

[jira] [Resolved] (KAFKA-5122) Kafka Streams unexpected off-heap memory growth

[ https://issues.apache.org/jira/browse/KAFKA-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5122. -- Resolution: Not A Problem > Kafka Streams unexpected off-heap memory growth > -

Re: [VOTE] 2.2.0 RC1

Thanks for the correction! -Matthias On 3/1/19 12:13 PM, Kevin Lu wrote: > Hi Matthias, > > The Confluence release page is correct, but the “ - Add --under-min-isr > option to describe topics command” was pushed back to 2.3.0. > > Thanks, > Kevin > > On Fri, Mar 1, 2019 at 11:48 AM Matthias J.

[jira] [Reopened] (KAFKA-3884) KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging

[ https://issues.apache.org/jira/browse/KAFKA-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3884: > KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging > -

[jira] [Reopened] (KAFKA-7652) Kafka Streams Session store performance degradation from 0.10.2.2 to 0.11.0.0

[ https://issues.apache.org/jira/browse/KAFKA-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-7652: -- > Kafka Streams Session store performance degradation from 0.10.2.2 to 0.11.0.0 > -

[jira] [Created] (KAFKA-8029) Add in-memory bytes-only session store implementation

Guozhang Wang created KAFKA-8029: Summary: Add in-memory bytes-only session store implementation Key: KAFKA-8029 URL: https://issues.apache.org/jira/browse/KAFKA-8029 Project: Kafka Issue Typ

Re: [DISCUSS] KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

+1, looks like a good improvement! Best, Colin On Mon, Feb 18, 2019, at 14:00, Mateusz Zakarczemny wrote: > Hi all, > > I have created a KIP to support additional message fields in console > consumer: > KIP-431 - Support of printing additional ConsumerRecord fields in > DefaultMessageFormatter >

Build failed in Jenkins: kafka-2.2-jdk8 #41

See Changes: [wangguoz] HOTFIX: add igore import to streams_upgrade_test -- [...truncated 2.73 MB...] kafka.admin.TopicCommandWithAdminClientTest > testCreate PASSED kafka.a

Re: [DISCUSS] KIP-426: Persist Broker Id to Zookeeper

Hi, Cluster management tools are more generic and they are not aware of Kafka specific configs like broker.id. Even if they are aware of broker.id's , they will be lost when a disk is lost. Irrespective of these use cases, let's look at the problem in isolation. 1. disks are the most c

Jenkins build is back to normal : kafka-trunk-jdk8 #3430

See

Jenkins build is back to normal : kafka-2.2-jdk8 #42

See