[GitHub] kafka pull request #1586: Kafka 3836: KStreamReduce and KTableReduce should ...

GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/1586 Kafka 3836: KStreamReduce and KTableReduce should not pass nulls to Deserializers You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeyhunk

[jira] [Commented] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362262#comment-15362262 ] Joseph Francis commented on KAFKA-3047: --- Hi [~guozhang], We were running kafka 0.9

[jira] [Issue Comment Deleted] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3047: --- Comment: was deleted (was: Good to know, thanks for explanation!) > Explicit offset assignment in Log

[jira] [Issue Comment Deleted] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3047: --- Comment: was deleted (was: Good to know, thanks for explanation!) > Explicit offset assignment in Log

[GitHub] kafka pull request #1587: MINOR: fix generics in Windows.segments and Window...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1587 MINOR: fix generics in Windows.segments and Windows.until `Windows.segments(...)` and `Windows.until(...)` currently aren't returning the `Window` with its type param `W`. This causes the generic type

[jira] [Updated] (KAFKA-3478) Finer Stream Flow Control

[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-3478: Description: Today we have a event-time based flow control mechanism in order to synchronize multip

[GitHub] kafka pull request #1588: KAFKA-3825: Allow users to specify different types...

GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/1588 KAFKA-3825: Allow users to specify different types of state stores in Streams DSL You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeyhunk

[jira] [Commented] (KAFKA-3825) Allow users to specify different types of state stores in Streams DSL

[ https://issues.apache.org/jira/browse/KAFKA-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362458#comment-15362458 ] ASF GitHub Bot commented on KAFKA-3825: --- GitHub user jeyhunkarimov opened a pull req

[jira] [Assigned] (KAFKA-3873) Gradle Test Executor non-zero exit code when running streams tests

[ https://issues.apache.org/jira/browse/KAFKA-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-3873: - Assignee: Damian Guy (was: Guozhang Wang) > Gradle Test Executor non-zero exit code when running

[jira] [Resolved] (KAFKA-3873) Gradle Test Executor non-zero exit code when running streams tests

[ https://issues.apache.org/jira/browse/KAFKA-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-3873. --- Resolution: Duplicate Fix Version/s: 0.10.1.0 Fixed by KAFKA-3896 > Gradle Test Executor non-z

[jira] [Resolved] (KAFKA-3884) KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging

[ https://issues.apache.org/jira/browse/KAFKA-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-3884. --- Resolution: Fixed Fixed by KAFKA-3842 > KGroupedStreamIntegrationTest.shouldAggregate seems to be han

Kafka Streams - production use

Hello, According to the FAQ (http://docs.confluent.io/3.0.0/streams/faq.html) it is not recommended to use Kafka Stream for production. When do you expect that it is ready for production use? Within the version 0.10.x.x or with later versions? Best regards Dirk Jeßberger -- Dirk Jeßberger Senio

[jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362604#comment-15362604 ] Andy Coates commented on KAFKA-3919: Hi [~junrao], thanks for taking the time to look

[jira] [Updated] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-3919: --- Description: Hi All, I encountered an issue with Kafka following a power outage that saw a proportio

[jira] [Updated] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-3919: --- Description: Hi All, I encountered an issue with Kafka following a power outage that saw a proportio

[GitHub] kafka pull request #1580: Hotfix: auto-repartitioning for merge() and code s...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1580 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362701#comment-15362701 ] Maysam Yabandeh commented on KAFKA-3410: We ran into this problem again and this t

[GitHub] kafka pull request #1584: MINOR: fix generics in KStream.groupBy(...)

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1584 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3928) Support a list of partition field names

[ https://issues.apache.org/jira/browse/KAFKA-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362773#comment-15362773 ] Ewen Cheslack-Postava commented on KAFKA-3928: -- [~striderapache] You probably

[jira] [Commented] (KAFKA-3927) kafka broker config docs issue

[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362776#comment-15362776 ] Sriharsha Chintalapani commented on KAFKA-3927: --- [~guoxu1231] config/server.

[jira] [Resolved] (KAFKA-3928) Support a list of partition field names

[ https://issues.apache.org/jira/browse/KAFKA-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3928. -- Resolution: Invalid > Support a list of partition field names >

[jira] [Resolved] (KAFKA-3897) Improve Unit Tests for New Consumer's Regex Subscription

[ https://issues.apache.org/jira/browse/KAFKA-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian resolved KAFKA-3897. Resolution: Duplicate > Improve Unit Tests for New Consumer's Regex Subscription > -

[jira] [Commented] (KAFKA-3897) Improve Unit Tests for New Consumer's Regex Subscription

[ https://issues.apache.org/jira/browse/KAFKA-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362786#comment-15362786 ] Vahid Hashemian commented on KAFKA-3897: An integration test was submitted as part

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases wh

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362788#comment-15362788 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull reques

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362787#comment-15362787 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull reques

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

Build failed in Jenkins: kafka-trunk-jdk7 #1403

See Changes: [wangguoz] HOTFIX: Auto-repartitioning for merge() and code simplifications [wangguoz] MINOR: Fix generics in KStream.groupBy(...) -- [...truncated 3313 lines...] kafka.coordinato

[jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362865#comment-15362865 ] Jun Rao commented on KAFKA-3919: [~BigAndy], thanks for the investigation and the addition

[jira] [Created] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

Guozhang Wang created KAFKA-3929: Summary: Add prefix for underlying clients configs in StreamConfig Key: KAFKA-3929 URL: https://issues.apache.org/jira/browse/KAFKA-3929 Project: Kafka Issue

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362972#comment-15362972 ] Guozhang Wang commented on KAFKA-3876: -- I have seen a similar failure for a different

[GitHub] kafka pull request #1587: MINOR: fix generics in Windows.segments and Window...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1587 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Comment Edited] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362993#comment-15362993 ] Ishita Mandhan edited comment on KAFKA-3876 at 7/5/16 6:48 PM: -

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362993#comment-15362993 ] Ishita Mandhan commented on KAFKA-3876: --- I saw a similar one too - https://builds.a

[jira] [Assigned] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishita Mandhan reassigned KAFKA-3929: - Assignee: Ishita Mandhan > Add prefix for underlying clients configs in StreamConfig > --

[jira] [Commented] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363051#comment-15363051 ] Ishita Mandhan commented on KAFKA-3929: --- Are you thinking a similar implementation t

Build failed in Jenkins: kafka-trunk-jdk7 #1404

See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 3313 lines...] kafka.coordinator.GroupMetadataManagerTest > testStoreNonEmptyGroup PASSED kaf

Build failed in Jenkins: kafka-0.10.0-jdk7 #142

See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 4015 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[5] PASSED kafka.lo

Build failed in Jenkins: kafka-trunk-jdk8 #734

See Changes: [wangguoz] HOTFIX: Auto-repartitioning for merge() and code simplifications [wangguoz] MINOR: Fix generics in KStream.groupBy(...) -- [...truncated 2043 lines...] at java.u

Re: Can I get a code review on my PR for KAFKA-3809? "Auto-generate documentation for topic-level configuration"

Hi Kafka devs, Checking in again. Can I get a code review on this? Thanks, -James > On Jun 30, 2016, at 1:51 PM, James Cheng wrote: > > Hi Kafka devs, > > Can I get a code review on my pull request for > https://issues.apache.org/jira/browse/KAFKA-3809? > > The code has been waiting for re

Build failed in Jenkins: kafka-trunk-jdk8 #735

See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 2374 lines...] kafka.api.ApiUtilsTest > testShortStringNonASCII PASSED kafka.api.ApiUtilsTest >

NPE using GenericAvroSerde to deserialize

This is possibly more of a Confluent question as GenericAvroSerde is in Confluent example code base. I have a small Stream application, which creates a KTable with String key and GenericRecord value. I then specify a Serde (new GenericAvroSerde) as value deserializer when outputting to topic via

[jira] [Commented] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363389#comment-15363389 ] Guozhang Wang commented on KAFKA-3929: -- I think it'll be better to just define the pr

[GitHub] kafka pull request #1589: MINOR: Increase default `waitTime` in `waitUntilTr...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1589 MINOR: Increase default `waitTime` in `waitUntilTrue` to 10 seconds 5 seconds is probably enough when running tests locally, but doesn't seem to be so for Jenkins when it is overloaded. You can me

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363465#comment-15363465 ] Ismael Juma commented on KAFKA-3876: You're probably right [~guozhang]. Here's a PR th

Re: [DISCUSS] KIP-53 Add custom policies for reconnect attempts to NetworkdClient

Hi Dana, Thanks for the PR. Technically, a (simple) KIP is required when proposing new configs. Ismael On Sun, Jun 19, 2016 at 7:42 PM, Dana Powers wrote: > I took a stab at implementing a simplified exponential + randomized > backoff policy here: https://github.com/apache/kafka/pull/1523 > >

[jira] [Commented] (KAFKA-3927) kafka broker config docs issue

[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363608#comment-15363608 ] Shawn Guo commented on KAFKA-3927: -- these parameters have default value in 0.8 version in

[jira] [Comment Edited] (KAFKA-3927) kafka broker config docs issue

[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363608#comment-15363608 ] Shawn Guo edited comment on KAFKA-3927 at 7/6/16 2:25 AM: -- these

[jira] [Comment Edited] (KAFKA-3927) kafka broker config docs issue

[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363608#comment-15363608 ] Shawn Guo edited comment on KAFKA-3927 at 7/6/16 2:35 AM: -- these

[jira] [Work started] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3926 started by Bill Bejeck. -- > Transient failures in > org.apache.kafka.streams.integration.RegexSourceIntegratio

[jira] [Commented] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363724#comment-15363724 ] Bill Bejeck commented on KAFKA-3926: Looking at this a bit more. The test in question

[GitHub] kafka pull request #1590: KAFKA-3926: confirm all expected topics added/remo...

GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/1590 KAFKA-3926: confirm all expected topics added/removed in createStream… …Tasks call versus simply asserting createStreamTasks method called. You can merge this pull request into a Git repository

[jira] [Commented] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363765#comment-15363765 ] ASF GitHub Bot commented on KAFKA-3926: --- GitHub user bbejeck opened a pull request: