Build failed in Jenkins: kafka-trunk-jdk7 #1639

See Changes: [jason] MINOR: Replaced unnecessary map and getOrElse with exists -- [...truncated 12372 lines...] org.apache.kafka.common.record.RecordTest > testFields[185] PASSED org.apache.kaf

[jira] [Created] (KAFKA-4314) Kafka Streams documentation needs definitive rework and improvement

Seweryn Habdank-Wojewodzki created KAFKA-4314: - Summary: Kafka Streams documentation needs definitive rework and improvement Key: KAFKA-4314 URL: https://issues.apache.org/jira/browse/KAFKA-4314

[jira] [Created] (KAFKA-4315) Kafka Connect documentation problems

Seweryn Habdank-Wojewodzki created KAFKA-4315: - Summary: Kafka Connect documentation problems Key: KAFKA-4315 URL: https://issues.apache.org/jira/browse/KAFKA-4315 Project: Kafka

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587966#comment-15587966 ] Greg Fodor commented on KAFKA-4113: --- Having played around with Kafka Streams for a while

[jira] [Created] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

Seweryn Habdank-Wojewodzki created KAFKA-4316: - Summary: Kafka Streams 0.10.0.1 does not run on Windows x64 Key: KAFKA-4316 URL: https://issues.apache.org/jira/browse/KAFKA-4316 Project: Ka

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587991#comment-15587991 ] Greg Fodor commented on KAFKA-4113: --- I guess what I would argue is that KStreamBuilder#t

[jira] [Created] (KAFKA-4317) RocksDB checkpoint files lost on kill -9

Greg Fodor created KAFKA-4317: - Summary: RocksDB checkpoint files lost on kill -9 Key: KAFKA-4317 URL: https://issues.apache.org/jira/browse/KAFKA-4317 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588096#comment-15588096 ] Damian Guy commented on KAFKA-4311: --- [~flyaruu] We are unable to reproduce or find the p

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588149#comment-15588149 ] Michael Noll commented on KAFKA-4316: - [~habdank]: Thanks for reporting this. FYI: T

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-4316: Description: We had encountered the problem that starting application with Kafka Streams 0.10.0.1 l

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-4316: Description: We had encountered the problem that starting application with Kafka Streams 0.10.0.1 l

[jira] [Work started] (KAFKA-4318) Migrate ProducerSendTest to the new consumer

[ https://issues.apache.org/jira/browse/KAFKA-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4318 started by Balint Molnar. > Migrate ProducerSendTest to the new consumer >

[jira] [Created] (KAFKA-4318) Migrate ProducerSendTest to the new consumer

Balint Molnar created KAFKA-4318: Summary: Migrate ProducerSendTest to the new consumer Key: KAFKA-4318 URL: https://issues.apache.org/jira/browse/KAFKA-4318 Project: Kafka Issue Type: Bug

Kafka running on Ceph

Hi, I found following post from achieve, but no any response. Any comments, future development and roadmap for that feature? --- From: Connie Yang To: us...@kafka.apache.org Content-Type: multipart/alternative; boundary=001a11c38a9

[jira] [Created] (KAFKA-4319) AbstractFetcherManager shutdown speedup

Alexey Ozeritskiy created KAFKA-4319: Summary: AbstractFetcherManager shutdown speedup Key: KAFKA-4319 URL: https://issues.apache.org/jira/browse/KAFKA-4319 Project: Kafka Issue Type: Imp

[jira] [Updated] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Ozeritskiy updated KAFKA-4319: - Status: Patch Available (was: Open) https://github.com/apache/kafka/pull/2023 > Abstract

[jira] [Created] (KAFKA-4320) Log compaction docs update

Dustin Cote created KAFKA-4320: -- Summary: Log compaction docs update Key: KAFKA-4320 URL: https://issues.apache.org/jira/browse/KAFKA-4320 Project: Kafka Issue Type: Bug Components: do

[jira] [Updated] (KAFKA-4320) Log compaction docs update

[ https://issues.apache.org/jira/browse/KAFKA-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated KAFKA-4320: --- Labels: newbie (was: ) > Log compaction docs update > -- > >

[jira] [Assigned] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4295: --- Assignee: huxi > kafka-console-consumer.sh does not delete the temporary group in zookeeper > ---

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588725#comment-15588725 ] huxi commented on KAFKA-4295: - I think we'd better follow what 0.8.x does for us. Removed con

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588733#comment-15588733 ] huxi commented on KAFKA-4295: - I think we'd better follow what 0.8.x does for us. Removed con

[jira] [Issue Comment Deleted] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4295: Comment: was deleted (was: I think we'd better follow what 0.8.x does for us. Removed consumer group's persisitent

[jira] [Commented] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588765#comment-15588765 ] Jiangjie Qin commented on KAFKA-3995: - [~mgharat] Could you elaborate on what is the w

Re: [VOTE] 0.10.1.0 RC3

+1 (non-binding). Verified source and Scala 2.11 binary artifacts, ran ./gradlew test with JDK 7u80, quick start on source artifact and Scala 2.11 binary artifacts. Thanks for managing the release! Ismael On Sat, Oct 15, 2016 at 12:29 AM, Jason Gustafson wrote: > Hello Kafka users, developers

Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

Hi, I have a consumer which implements new consumer api (0.9.0.1). I see below errors quite frequently in the consumer application logs: ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group audit.consumer.group Can you ple

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589074#comment-15589074 ] Frank Lyaruu commented on KAFKA-4311: - I'm working on it, and frankly I'm at a loss.

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589089#comment-15589089 ] Damian Guy commented on KAFKA-4311: --- Thanks - i'll take a look at it what your repositor

Re: [VOTE] 0.10.1.0 RC3

+1 (non-binding) passes librdkafka test suites 2016-10-19 15:55 GMT+02:00 Ismael Juma : > +1 (non-binding). > > Verified source and Scala 2.11 binary artifacts, ran ./gradlew test with > JDK 7u80, quick start on source artifact and Scala 2.11 binary artifacts. > > Thanks for managing the release!

[jira] [Commented] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589236#comment-15589236 ] ASF GitHub Bot commented on KAFKA-4319: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2023: KAFKA-4319; AbstractFetcherManager: shutdown speed...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2023 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4319: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch Avail

[jira] [Created] (KAFKA-4321) Make client.id available to MetricReporter and (De)Serializers in clients

Sumit Arrawatia created KAFKA-4321: -- Summary: Make client.id available to MetricReporter and (De)Serializers in clients Key: KAFKA-4321 URL: https://issues.apache.org/jira/browse/KAFKA-4321 Project:

Re: [VOTE] 0.10.1.0 RC3

+1 from myself too. The vote passes with 9 +1 votes and no 0 or -1 votes. +1 votes PMC Members: * Gwen Shapira * Jun Rao * Neha Narkhede Committers: * Ismael Juma * Jason Gustafson Community: * Eno Thereska * Manikumar Reddy * Dana Powers * Magnus Edenhill 0 votes * No votes -1 votes * No vot

[jira] [Resolved] (KAFKA-4215) Consumers miss messages during partition reassignment

[ https://issues.apache.org/jira/browse/KAFKA-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta resolved KAFKA-4215. - Resolution: Won't Fix This is the expected behavior. When the replication factor is 1, and when we

[jira] [Updated] (KAFKA-4321) Make client.id available to MetricReporter and (De)Serializers in clients

[ https://issues.apache.org/jira/browse/KAFKA-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Arrawatia updated KAFKA-4321: --- Description: Currently, only the interceptors get the default client.id (which is generated if

[GitHub] kafka pull request #2044: Changes for supporting unsgined tinyint values

GitHub user vamossagar12 opened a pull request: https://github.com/apache/kafka/pull/2044 Changes for supporting unsgined tinyint values Based upon the theory provided in the official jdbc documentation, I have added a condition to include both Short and Byte as INT8 types in Connec

Build failed in Jenkins: kafka-trunk-jdk8 #988

See Changes: [jason] KAFKA-4319; Parallelize shutdown of fetchers in AbstractFetcherManager -- [...truncated 14188 lines...] org.apache.kafka.streams.StreamsConfigTest > shouldSupportPrefixedPro

Jenkins build is back to normal : kafka-trunk-jdk7 #1640

See

Re: Kafka KIP meeting Oct 19 at 11:00am PST

The following are the notes from today's KIP discussion. - KIP-82 - add record header: We agreed that there are use cases for third-party vendors building tools around Kafka. We haven't reached the conclusion whether the added complexity justifies the use cases. We will follow up on t

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589756#comment-15589756 ] Seweryn Habdank-Wojewodzki commented on KAFKA-4316: --- Thanks a lot for ve

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589806#comment-15589806 ] Michael Noll commented on KAFKA-4316: - [~habdank]: Sounds good. FYI: The vote on rel

[GitHub] kafka pull request #2038: HOTFIX: Fix put logic

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2038 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2036: MINOR: Update rocksDB dependency to 4.11.2

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2036 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2030: MINOR: Added more basic concepts to the documentat...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2030 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4312: - Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0

[jira] [Reopened] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat reopened KAFKA-3995: > Add a new configuration "enable.comrpession.ratio.estimation" to the producer > config >

[jira] [Commented] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589938#comment-15589938 ] Mayuresh Gharat commented on KAFKA-3995: If we disable compression, we would not h

Build failed in Jenkins: kafka-trunk-jdk8 #989

See Changes: [wangguoz] HOTFIX: Fix putAll and putIfAbsent logic for correct eviction behavior -- [...truncated 14202 lines...] org.apache.kafka.streams.processor.internals.AbstractTaskTest > s

[GitHub] kafka-site pull request #25: Enable 0.10.1 documentation

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka-site/pull/25 Enable 0.10.1 documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka-site activate-0.10.1-docs Alternatively you ca

[GitHub] kafka-site issue #25: Enable 0.10.1 documentation

Github user gwenshap commented on the issue: https://github.com/apache/kafka-site/pull/25 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4316: - Component/s: streams > Kafka Streams 0.10.0.1 does not run on Windows x64 > --

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4316: - Affects Version/s: 0.10.0.1 > Kafka Streams 0.10.0.1 does not run on Windows x64 > ---

[GitHub] kafka pull request #1961: KAFKA-4250: make ProducerRecord and ConsumerRecord...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1961 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: KStreams / add support for sink processor with dynamic topics

We can consider adding this feature to with a StreamsAdminClient that we are adding as part of KAFKA-4060. However, I'm still not sure if it should be added on the DSL layer or on the Processor API layer. Florian, what do you mean that the Processor is not "completely safe"? Do you mean not strong

[GitHub] kafka pull request #2042: KAFKA-4312: If filePath is empty string writeAsTex...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4250) make ProducerRecord and ConsumerRecord extensible

[ https://issues.apache.org/jira/browse/KAFKA-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590239#comment-15590239 ] ASF GitHub Bot commented on KAFKA-4250: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590240#comment-15590240 ] ASF GitHub Bot commented on KAFKA-4312: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4250) make ProducerRecord and ConsumerRecord extensible

[ https://issues.apache.org/jira/browse/KAFKA-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-4250. --- Resolution: Fixed Assignee: radai rosenblatt Reviewer: Joel Koshy Fix Version/

Jenkins build is back to normal : kafka-trunk-jdk8 #990

See

Build failed in Jenkins: kafka-0.10.1-jdk7 #79

See Changes: [wangguoz] MINOR: Added more basic concepts to the documentation -- [...truncated 7393 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[1] STARTED kafka.log.Bro

Re: [VOTE] KIP-73 - Replication Quotas

Hi, While testing KIP-73, we found an issue described in https://issues.apache.org/jira/browse/KAFKA-4313. Basically, when there are mixed high-volume and low-volume partitions, when replication throttling is specified, ISRs for those low volume partitions could thrash. KAFKA-4313 fixes this issue

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590599#comment-15590599 ] huxi commented on KAFKA-4295: - The design is not changed. 0.9.x still removes the zk nodes for

[GitHub] kafka pull request #2039: HOTFIX: follow up on KAFKA-4275

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2039 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590693#comment-15590693 ] ASF GitHub Bot commented on KAFKA-4275: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4269: - Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0

[GitHub] kafka pull request #2005: KAFKA-4269 extracted code updating topics when reg...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2005 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590710#comment-15590710 ] ASF GitHub Bot commented on KAFKA-4269: --- Github user asfgit closed the pull request

Build failed in Jenkins: kafka-trunk-jdk8 #992

See Changes: [wangguoz] HOTFIX: follow up on KAFKA-4275 [wangguoz] KAFKA-4269: Update topic subscription when regex pattern specified out -- [...truncated 7893 lines...] kafka.integration.Sasl

Build failed in Jenkins: kafka-trunk-jdk7 #1643

See Changes: [wangguoz] HOTFIX: follow up on KAFKA-4275 [wangguoz] KAFKA-4269: Update topic subscription when regex pattern specified out -- [...truncated 14242 lines...] org.apache.kafka.stre