[jira] [Updated] (KAFKA-3802) log mtimes reset on broker restart

2016-06-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-3802: --- Status: Patch Available (was: Open) > log mtimes reset on broker restart > --

Jenkins build is back to normal : kafka-trunk-jdk8 #699

2016-06-15 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332996#comment-15332996 ] Jason Gustafson commented on KAFKA-3144: [~junrao], [~vahid] Another helpful featu

[jira] [Commented] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332964#comment-15332964 ] ASF GitHub Bot commented on KAFKA-3850: --- GitHub user hachikuji reopened a pull reque

[jira] [Commented] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332963#comment-15332963 ] ASF GitHub Bot commented on KAFKA-3850: --- Github user hachikuji closed the pull reque

[jira] [Updated] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3850: --- Status: Patch Available (was: Open) > WorkerSinkTask should retry commits if woken up during

[GitHub] kafka pull request #1511: KAFKA-3850: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/1511 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Created] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3850: -- Summary: WorkerSinkTask should retry commits if woken up during rebalance or shutdown Key: KAFKA-3850 URL: https://issues.apache.org/jira/browse/KAFKA-3850 Projec

[GitHub] kafka pull request #1511: KAFKA-3850: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
GitHub user hachikuji reopened a pull request: https://github.com/apache/kafka/pull/1511 KAFKA-3850: WorkerSinkTask commit prior to rebalance should be retried on wakeup You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/

[jira] [Updated] (KAFKA-2720) Periodic purging groups in the coordinator

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2720: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332949#comment-15332949 ] ASF GitHub Bot commented on KAFKA-2720: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1427: KAFKA-2720: expire group metadata when all offsets...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332913#comment-15332913 ] ASF GitHub Bot commented on KAFKA-3443: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1477: KAFKA-3443 [Kafka Stream] support for adding sourc...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1477 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3443: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

Build failed in Jenkins: kafka-trunk-jdk8 #698

2016-06-15 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3753: Add approximateNumEntries() method to KeyValueStore -- [...truncated 12519 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByAlias STAR

[GitHub] kafka pull request #1511: KAFKA-XXXX: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1511 KAFKA-: WorkerSinkTask commit prior to rebalance should be retried on wakeup You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/ka

[GitHub] kafka pull request #1486: KAFKA-3753: Add approximateNumEntries() method to ...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1486 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

RE: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Subhash Agrawal
Thanks for quick response. I started zookeeper via zookeeper-server-start.bat and started kafka via my java process and I saw same error. But if I start zookeeper via java process and start kafka via kafka-server-start.bat, t works fine. It means it is not caused due to both getting started in sa

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332801#comment-15332801 ] Vahid Hashemian commented on KAFKA-3818: [~granthenke] I believe the problem you m

[jira] [Comment Edited] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332798#comment-15332798 ] Jason Gustafson edited comment on KAFKA-3818 at 6/15/16 11:04 PM: --

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332798#comment-15332798 ] Jason Gustafson commented on KAFKA-3818: [~granthenke] Good question. The round ro

Re: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Guozhang Wang
It seems "scala.MatchError: null" are not related to the settings that ZK and Kafka is embedded in the same process, and the only case that I can think of related is this: https://issues.apache.org/jira/browse/KAFKA-940. Could you clarify if you start these two services on two processes, the issue

Re: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Flavio Junqueira
> On 15 Jun 2016, at 21:56, Subhash Agrawal wrote: > > [2016-06-15 13:39:39,808] DEBUG [ZkClient-EventThread-24-localhost:2181] > [Channel manager on controller 0]: Controller 0 trying to connect to broker 0 > (kafka.controller.ControllerChannelManager) The controller isn't being able to con

Re: Memory consumption of Kafka-examples Kafka-streams around 1.5 GB

2016-06-15 Thread Philippe Derome
Guozhang, No two in particular, at first it was simply the last two that the target would choose: SumLambdaIntegrationTest and WordCountLambdaIntegrationTest . I tried another couple to exclude and it was fine as well. There's one Scala test that is included in the run and I run it as well as 7/9

[jira] [Commented] (KAFKA-3536) ReplicaFetcherThread should not log errors when leadership changes

2016-06-15 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332767#comment-15332767 ] Jason Rosenberg commented on KAFKA-3536: which version are you seeing this in (I'm

Re: Complexe Event Processing on top of KafkaStreams

2016-06-15 Thread Guozhang Wang
Hello Florian, Thanks for your interests! As mentioned in our release notes we are considering to add the SQL support (e.g. using Calcite) on top of Kafka Streams as a near-term future work. My own experience with CEP originates completely from a research project called "Cayuga" from my grad scho

Re: Memory consumption of Kafka-examples Kafka-streams around 1.5 GB

2016-06-15 Thread Guozhang Wang
Hello Phillippe, I used to run the "SimpleBenchmark" on my laptop with 4GB also, and it usually used close to, but less than 1GB. https://www.codatlas.com/github.com/apache/kafka/HEAD/streams/src/test/java/org/apache/kafka/streams/perf/SimpleBenchmark.java Note that I need to bootstrap a real ZK

[jira] [Commented] (KAFKA-3822) Kafka Consumer close() hangs indefinitely if Kafka Broker shutdown while connected

2016-06-15 Thread Alexander Cook (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332736#comment-15332736 ] Alexander Cook commented on KAFKA-3822: --- I got to try this out today, and you are co

[jira] [Created] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

2016-06-15 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-3849: - Summary: Make consumer poll time in MirrorMaker configurable. Key: KAFKA-3849 URL: https://issues.apache.org/jira/browse/KAFKA-3849 Project: Kafka Issue Ty

[jira] [Commented] (KAFKA-3693) Race condition between highwatermark-checkpoint thread and handleLeaderAndIsrRequest at broker start-up

2016-06-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332684#comment-15332684 ] Jun Rao commented on KAFKA-3693: [~maysamyabandeh], that by itself may not be a bad idea.

[jira] [Commented] (KAFKA-3059) ConsumerGroupCommand should allow resetting offsets for consumer groups

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332660#comment-15332660 ] Guozhang Wang commented on KAFKA-3059: -- Chiming in here since Streams may need this f

Jenkins build is back to normal : kafka-trunk-jdk8 #697

2016-06-15 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3059) ConsumerGroupCommand should allow resetting offsets for consumer groups

2016-06-15 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332649#comment-15332649 ] Henry Cai commented on KAFKA-3059: -- We would like to have the capability to move the offs

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-15 Thread Jun Rao
Hi, Rajini, Thanks for the updated wiki. Overall, I like the new approach. It covers the common use cases now, is extensible, and is backward compatible. A few comments below. 1. It would be useful to describe a bit at the high level, how the new approach works. I think this can be summarized as

[jira] [Commented] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332632#comment-15332632 ] Bharat Viswanadham commented on KAFKA-3837: --- Hi Simon, I will update the code to

[jira] [Updated] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3837: -- Status: Open (was: Patch Available) > Report the name of the blocking thread when throw

[jira] [Work started] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3837 started by Bharat Viswanadham. - > Report the name of the blocking thread when throwing > ConcurrentMod

[jira] [Commented] (KAFKA-3693) Race condition between highwatermark-checkpoint thread and handleLeaderAndIsrRequest at broker start-up

2016-06-15 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332618#comment-15332618 ] Maysam Yabandeh commented on KAFKA-3693: Thinking more about this, the complexity

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332583#comment-15332583 ] James Cheng commented on KAFKA-3848: Better documentation might help. Unfortunately, s

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Grant Henke
Turns out we already have an InvalidRequestException: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/network/RequestChannel.scala#L75-L98 We just don't map it in Errors.java so it results in an UNKNOWN error when sent back to the client. I will migrate the InvalidRequestExce

Embedding zookeeper and kafka in java process.

2016-06-15 Thread Subhash Agrawal
Hi All, I am embedding Kafka 0.10.0 and corresponding zookeeper in java process. In this process, I start zookeeper first and then wait for 10 seconds and then start kafka. These are all running in the same process. Toward the end of kafka startup, I see following exception. It seems zookeeper is

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Clarke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332534#comment-15332534 ] James Clarke commented on KAFKA-3848: - Thanks for the quick rely. I think you might be

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332529#comment-15332529 ] James Cheng commented on KAFKA-3848: Somewhat related to https://issues.apache.org/jir

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332524#comment-15332524 ] Grant Henke commented on KAFKA-3818: A few older threads mention that its possible to

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332480#comment-15332480 ] James Cheng commented on KAFKA-3848: This behavior may be related to the value of auto

Jenkins build is back to normal : kafka-trunk-jdk7 #1362

2016-06-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #696

2016-06-15 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3830; getTGT() debug logging exposes confidential information -- [...truncated 12504 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByAlias ST

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Dana Powers
On Wed, Jun 15, 2016 at 12:19 PM, Ismael Juma wrote: > Hi Grant, > > Comments below. > > On Wed, Jun 15, 2016 at 6:52 PM, Grant Henke wrote: >> >> The one thing I want to avoid is to many super specific error codes. I am >> not sure how much of a problem it really is but in the case of wire >> pr

[jira] [Created] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Clarke (JIRA)
James Clarke created KAFKA-3848: --- Summary: Mirror Maker sometimes fails to mirror first batch of messages Key: KAFKA-3848 URL: https://issues.apache.org/jira/browse/KAFKA-3848 Project: Kafka I

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Ismael Juma
Hi Grant, Comments below. On Wed, Jun 15, 2016 at 6:52 PM, Grant Henke wrote: > > The one thing I want to avoid is to many super specific error codes. I am > not sure how much of a problem it really is but in the case of wire > protocol errors like multiple instances of the same topic, do you ha

[GitHub] kafka pull request #1501: MINOR: Expose window store sequence number

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1501 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3753) Add approximateNumEntries() to the StateStore interface for metrics reporting

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3753: - Assignee: Jeff Klukas (was: Guozhang Wang) > Add approximateNumEntries() to the StateStore interf

[jira] [Updated] (KAFKA-3701) Expose KafkaStreams metrics in public API

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3701: - Assignee: (was: Guozhang Wang) > Expose KafkaStreams metrics in public API > -

[jira] [Updated] (KAFKA-3836) KStreamReduce and KTableReduce should not pass nulls to Deserializers

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3836: - Assignee: (was: Guozhang Wang) > KStreamReduce and KTableReduce should not pass nulls to Deser

[jira] [Updated] (KAFKA-3535) Add metrics ability for streams serde components

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3535: - Assignee: (was: Guozhang Wang) > Add metrics ability for streams serde components > --

[jira] [Updated] (KAFKA-3545) Generalized Serdes for List/Map

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3545: - Assignee: (was: Guozhang Wang) > Generalized Serdes for List/Map > ---

[jira] [Updated] (KAFKA-3595) Add capability to specify replication compact option for stream store

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3595: - Assignee: (was: Guozhang Wang) > Add capability to specify replication compact option for stre

[jira] [Updated] (KAFKA-3545) Generalized Serdes for List/Map

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3545: - Labels: api newbie (was: api) > Generalized Serdes for List/Map > ---

[jira] [Updated] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3752: - Assignee: (was: Guozhang Wang) > Provide a way for KStreams to recover from unclean shutdown >

[jira] [Updated] (KAFKA-3576) Unify KStream and KTable API

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3576: - Assignee: Damian Guy (was: Guozhang Wang) > Unify KStream and KTable API > --

[jira] [Updated] (KAFKA-3741) KStream config for changelog min.in.sync.replicas

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3741: - Assignee: (was: Guozhang Wang) > KStream config for changelog min.in.sync.replicas > -

[jira] [Updated] (KAFKA-3770) KStream job should be able to specify linger.ms

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3770: - Assignee: Greg Fodor (was: Guozhang Wang) > KStream job should be able to specify linger.ms > ---

[jira] [Updated] (KAFKA-3708) Rethink exception handling in KafkaStreams

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3708: - Assignee: (was: Guozhang Wang) > Rethink exception handling in KafkaStreams >

[jira] [Updated] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3729: - Labels: api newbie (was: api) > Auto-configure non-default SerDes passed alongside the topology

[jira] [Updated] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3729: - Assignee: (was: Guozhang Wang) > Auto-configure non-default SerDes passed alongside the topol

[jira] [Updated] (KAFKA-3543) Allow a variant of transform() which can emit multiple values

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3543: - Assignee: (was: Guozhang Wang) > Allow a variant of transform() which can emit multiple values

[jira] [Created] (KAFKA-3847) Connect tasks should not share a producer

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3847: Summary: Connect tasks should not share a producer Key: KAFKA-3847 URL: https://issues.apache.org/jira/browse/KAFKA-3847 Project: Kafka Issue

[jira] [Updated] (KAFKA-3400) Topic stop working / can't describe topic

2016-06-15 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3400: -- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) Resolving this as

[jira] [Updated] (KAFKA-3820) Provide utilities for tracking source offsets

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3820: - Labels: needs-kip (was: ) > Provide utilities for tracking source offsets > -

[jira] [Updated] (KAFKA-2483) Add support for batch/scheduled Copycat connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2483: - Labels: needs-kip (was: ) > Add support for batch/scheduled Copycat connectors >

[jira] [Updated] (KAFKA-3819) Provide utilities for polling source connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3819: - Labels: needs-kip (was: ) > Provide utilities for polling source connectors > ---

[jira] [Updated] (KAFKA-3815) Support command line arguments in Kafka Connect distributed worker

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3815: - Labels: needs-kip (was: ) > Support command line arguments in Kafka Connect distr

[jira] [Updated] (KAFKA-2378) Add Copycat embedded API

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2378: - Labels: needs-kip (was: ) > Add Copycat embedded API > >

[jira] [Updated] (KAFKA-3254) Add Connect storage topic prefix for easier configuration

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3254: - Labels: needs-kip (was: ) > Add Connect storage topic prefix for easier configura

[jira] [Updated] (KAFKA-2376) Add Copycat metrics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2376: - Labels: needs-kip (was: ) > Add Copycat metrics > --- > >

[jira] [Updated] (KAFKA-3813) Let SourceConnector implementations access the offset reader

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3813: - Labels: needs-kip (was: ) > Let SourceConnector implementations access the offset

[jira] [Updated] (KAFKA-3821) Allow Kafka Connect source tasks to produce offset without writing to topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3821: - Labels: needs-kip (was: ) > Allow Kafka Connect source tasks to produce offset wi

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Labels: needs-kip (was: ) > KafkaConnect should support regular expression for to

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Labels: needs-kip (was: ) > Support single message transforms in Kafka Connect >

[jira] [Updated] (KAFKA-3487) Support per-connector/per-task classloaders in Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3487: - Labels: needs-kip (was: ) > Support per-connector/per-task classloaders in Connec

[jira] [Created] (KAFKA-3846) Connect record types should include timestamps

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3846: Summary: Connect record types should include timestamps Key: KAFKA-3846 URL: https://issues.apache.org/jira/browse/KAFKA-3846 Project: Kafka

[jira] [Created] (KAFKA-3845) Support per-connector converters

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3845: Summary: Support per-connector converters Key: KAFKA-3845 URL: https://issues.apache.org/jira/browse/KAFKA-3845 Project: Kafka Issue Type: Bu

[jira] [Updated] (KAFKA-3845) Support per-connector converters

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3845: - Issue Type: Improvement (was: Bug) > Support per-connector converters > -

[jira] [Updated] (KAFKA-3351) Kafka Connect Rest restarts all connectors on POST or DELETE

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3351: - Fix Version/s: (was: 0.10.1.0) > Kafka Connect Rest restarts all connectors on

[jira] [Updated] (KAFKA-2483) Add support for batch/scheduled Copycat connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2483: - Fix Version/s: (was: 0.10.1.0) > Add support for batch/scheduled Copycat conne

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Priority: Critical (was: Major) > Support single message transforms in Kafka Conn

[jira] [Updated] (KAFKA-3832) Kafka Connect's JSON Converter never outputs a null value

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3832: - Fix Version/s: 0.10.1.0 > Kafka Connect's JSON Converter never outputs a null valu

[jira] [Comment Edited] (KAFKA-2925) NullPointerException if FileStreamSinkTask is stopped before initialization finishes

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332159#comment-15332159 ] Ewen Cheslack-Postava edited comment on KAFKA-2925 at 6/15/16 5:38 PM: -

[jira] [Commented] (KAFKA-2925) NullPointerException if FileStreamSinkTask is stopped before initialization finishes

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332159#comment-15332159 ] Ewen Cheslack-Postava commented on KAFKA-2925: -- [~hachikuji] Can you remember

[jira] [Updated] (KAFKA-2941) Docs for key/value converter in Kafka connect are unclear

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2941: - Fix Version/s: 0.10.1.0 > Docs for key/value converter in Kafka connect are unclea

[jira] [Updated] (KAFKA-2941) Docs for key/value converter in Kafka connect are unclear

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2941: - Priority: Blocker (was: Minor) Bumping up the priority here as there's a seemingl

[jira] [Updated] (KAFKA-3054) Connect Herder fail forever if sent a wrong connector config or task config

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3054: - Priority: Blocker (was: Major) Fix Version/s: 0.10.1.0 We improved error

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-15 Thread Rajini Sivaram
Harsha, The sample configuration under https://cwiki.apache.org/confluence/display/KAFKA/KIP-55%3A+Secure+Quotas+for+Authenticated+Users#KIP-55:SecureQuotasforAuthenticatedUsers-QuotaConfiguration shows the Zookeeper data for different scenarios. - *user1* (/users/user1 in ZK) has only user-le

[jira] [Updated] (KAFKA-3008) Connect should parallelize task start/stop

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3008: - Priority: Minor (was: Major) > Connect should parallelize task start/stop > -

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Fix Version/s: 0.10.1.0 > Support single message transforms in Kafka Connect > ---

[jira] [Updated] (KAFKA-2378) Add Copycat embedded API

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2378: - Fix Version/s: (was: 0.10.1.0) > Add Copycat embedded API > --

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Issue Type: Improvement (was: Bug) > KafkaConnect should support regular expressi

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Fix Version/s: 0.10.1.0 > KafkaConnect should support regular expression for topic

[jira] [Updated] (KAFKA-3816) Provide more context in Kafka Connect log messages

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3816: - Priority: Critical (was: Major) > Provide more context in Kafka Connect log messa

  1   2   >