[GitHub] kafka pull request #3711: MINOR: Stateless transformation documentation

2017-08-22 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/3711 MINOR: Stateless transformation documentation Needs to come after https://github.com/apache/kafka/pull/3701 You can merge this pull request into a Git repository by running: $ git pull http

[jira] [Created] (KAFKA-5761) Serializer API should support ByteBuffer

2017-08-22 Thread Bhaskar Gollapudi (JIRA)
Bhaskar Gollapudi created KAFKA-5761: Summary: Serializer API should support ByteBuffer Key: KAFKA-5761 URL: https://issues.apache.org/jira/browse/KAFKA-5761 Project: Kafka Issue Type: Im

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-22 Thread Damian Guy
An update on the 0.11.0.1 release. We currently have 5 outstanding issues: https://issues.apache.org/jira/projects/KAFKA/versions/12340632 3 with patches available that we can hopefully get merged pretty soon (1 is actually already on 0.11.0.1) 2 issues that are Open, 1 is unassigned. Hopefully we

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

2017-08-22 Thread Ismael Juma
Hi all, The discussion has been going on for a while, would it help to have a call to discuss this? I'd like to start a vote soonish so that we can include this in 1.0.0. I personally prefer max.message.delivery.wait.ms. It seems like Jun, Apurva and Jason also prefer that. Sumant, it seems like y

[jira] [Resolved] (KAFKA-5689) Refactor WindowStore hierarchy so that Metered Store is the outermost store

2017-08-22 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5689. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3692 [https://github.com/

[GitHub] kafka pull request #3692: KAFKA-5689:Add MeteredWindowStore and refactor sto...

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5751) Kafka cannot start; corrupted index file(s)

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5751. -- Resolution: Duplicate > Kafka cannot start; corrupted index file(s) > --

Build failed in Jenkins: kafka-trunk-jdk7 #2660

2017-08-22 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-5689; Add MeteredWindowStore and refactor store hierarchy -- [...truncated 915.41 KB...] kafka.server.ControlledShutdownLeaderSelectorTest

Confluence access rights

2017-08-22 Thread Attila Kreiner
Hey All, I need to create a KIP for this: https://issues.apache.org/jira/browse/KAFKA-5726 https://github.com/apache/kafka/pull/3669 However, I can't edit the page https://cwiki.apache.org/ confluence/display/KAFKA/Kafka+Improvement+Proposals and when I click Create button I do not see the KIP te

Build failed in Jenkins: kafka-trunk-jdk8 #1929

2017-08-22 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-5689; Add MeteredWindowStore and refactor store hierarchy -- [...truncated 4.32 MB...] kafka.integration.AutoOffsetResetTest > testResetTo

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-22 Thread Rajini Sivaram
Hi all, If there are no more comments, I will start vote on this KIP tomorrow. Please let me know if there are any concerns. Thanks, Rajini On Mon, Aug 21, 2017 at 9:24 AM, Rajini Sivaram wrote: > Hi Jun, > > Thank you for the review. > > 1. Each token response will indicate success/failure.

Re: [DISCUSS] KIP-188 - Add new metrics to support health checks

2017-08-22 Thread Rajini Sivaram
Hi all, We can discuss the expiry implementation as part of the PR review. If there are no further comments, I will start vote on this KIP tomorrow. Please let me know if there are any other concerns. On Fri, Aug 18, 2017 at 4:55 AM, Rajini Sivaram wrote: > Perhaps we could register dynamically

[jira] [Created] (KAFKA-5762) Refactor AdminClient to use LogContext

2017-08-22 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5762: -- Summary: Refactor AdminClient to use LogContext Key: KAFKA-5762 URL: https://issues.apache.org/jira/browse/KAFKA-5762 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-187 - Add cumulative count metric for all Kafka rate metrics

2017-08-22 Thread Rajini Sivaram
Hi all, If there are no more comments, I will start vote on this KIP tomorrow. Please let me know if there are any other concerns. Thanks, Rajini On Fri, Aug 18, 2017 at 3:38 AM, Rajini Sivaram wrote: > Hi Jun, > > I have added constructors for all the variations. Haven't included these > in

[jira] [Created] (KAFKA-5763) Refactor NetworkClient to use LogContext

2017-08-22 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5763: -- Summary: Refactor NetworkClient to use LogContext Key: KAFKA-5763 URL: https://issues.apache.org/jira/browse/KAFKA-5763 Project: Kafka Issue Type: Improvement

[GitHub] kafka pull request #3701: MINOR: Document how to create source streams and t...

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3701 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-22 Thread Damian Guy
I've just updated the KIP with some additional changes targeted at StreamsBuilder Thanks, Damian On Thu, 10 Aug 2017 at 12:59 Damian Guy wrote: > >> Got it, thanks. >> >> Does it still make sense to have one static constructors for each spec, >> with one constructor having only one parameter to

Build failed in Jenkins: kafka-trunk-jdk7 #2661

2017-08-22 Thread Apache Jenkins Server
See Changes: [damian.guy] MINOR: Document how to create source streams and tables -- [...truncated 917.13 KB...] kafka.controller.ControllerEventManagerTest > testSuccess

[GitHub] kafka pull request #3696: KAFKA-4856: make unregisterAppInfo method to synch...

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4856) Calling KafkaProducer.close() from multiple threads may cause spurious error

2017-08-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4856. Resolution: Fixed Fix Version/s: 1.0.0 0.11.0.1 > Calling KafkaProducer.cl

Kafka monitoring - Facing issues

2017-08-22 Thread Dipan Shah
Hello All, We are moving into production for a Kafka project next week and we do not have a working monitoring tool that'll help us with it. We've tried 2 tools till now and none of them are working. 1) Datadog: There's a bug at their end and that's why it is not working. 2) Burrow: I tried

[GitHub] kafka pull request #3700: KAFKA-5752: Update timeIndex, txnIndex file pointe...

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3700 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1930

2017-08-22 Thread Apache Jenkins Server
See Changes: [damian.guy] MINOR: Document how to create source streams and tables -- [...truncated 926.34 KB...] kafka.controller.ControllerIntegrationTest > testLeaderA

[GitHub] kafka pull request #3691: HOTFIX: Cherrypicking state deadlock fix from 0.11

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3712: MINOR: Fix transient failure in SocketServerTest.t...

2017-08-22 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3712 MINOR: Fix transient failure in SocketServerTest.testConnectionIdReuse You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka

[jira] [Created] (KAFKA-5764) KafkaShortnamer should allow for case inensitive matches

2017-08-22 Thread Ryan P (JIRA)
Ryan P created KAFKA-5764: - Summary: KafkaShortnamer should allow for case inensitive matches Key: KAFKA-5764 URL: https://issues.apache.org/jira/browse/KAFKA-5764 Project: Kafka Issue Type: Improve

Build failed in Jenkins: kafka-trunk-jdk7 #2662

2017-08-22 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4856; Synchronize registerAppInfo and unregisterAppInfo -- [...truncated 919.94 KB...] kafka.server.ControlledShutdownLeaderSelectorTest > test

each file of the kafka data will be opened 70+ times

2017-08-22 Thread Zongwen Li
hi all, When i use kafka cluster in our project, we found a problem, each file(log, index, timeidex) of the kafka will be open many times(about 70+), was this normal? or was a bug? how to fix this. Thanks for your help! -- Best Regards! ___ Zongwe

Re: [DISCUSS] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-08-22 Thread Tom Bentley
Hi Jun, Thanks for the feedback. I've updated the KIP to mention this new algorithm, which I agree will be much better from the AdminClient PoV. I've also reverted the authorization to be against the cluster resource, rather than the topic, since, on re-reading, Ewen wasn't particularly advocati

Jenkins build is back to normal : kafka-trunk-jdk7 #2663

2017-08-22 Thread Apache Jenkins Server
See

Re: The last batch of data is never qualified for processing by the punctuate method. - Kafka Streams

2017-08-22 Thread Matthias J. Sax
The call to punctuate depend on progress on "stream time" (internally tracked progress of time, depending whatever is returned by TimestampExtractor). Thus, if you don't receive any more date, "stream time" does not make progress anymore and thus, punctuate is not called anymore. Does this explai

Build failed in Jenkins: kafka-trunk-jdk8 #1931

2017-08-22 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4856; Synchronize registerAppInfo and unregisterAppInfo [ismael] KAFKA-5752; Update index files correctly during async delete -- [...truncated

[jira] [Created] (KAFKA-5765) Move merge() from StreamsBuilder to KStream

2017-08-22 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5765: -- Summary: Move merge() from StreamsBuilder to KStream Key: KAFKA-5765 URL: https://issues.apache.org/jira/browse/KAFKA-5765 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-5401) Kafka Over TLS Error - Failed to send SSL Close message - Broken Pipe

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5401. -- Resolution: Duplicate > Kafka Over TLS Error - Failed to send SSL Close message - Broken Pipe >

[GitHub] kafka pull request #3675: KAFKA-5152: perform state restoration in poll loop

2017-08-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3675 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: Confluence access rights

2017-08-22 Thread Guozhang Wang
Attila, I have added you to the wiki page list. Cheers. Guozhang On Tue, Aug 22, 2017 at 4:29 AM, Attila Kreiner wrote: > Hey All, > > I need to create a KIP for this: > https://issues.apache.org/jira/browse/KAFKA-5726 > https://github.com/apache/kafka/pull/3669 > > However, I can't edit the

Build failed in Jenkins: kafka-trunk-jdk8 #1932

2017-08-22 Thread Apache Jenkins Server
See Changes: [damian.guy] HOTFIX: Cherrypicking state deadlock fix from 0.11 -- [...truncated 4.33 MB...] kafka.integration.AutoOffsetResetTest > testResetToEarliestWhenOf

[jira] [Resolved] (KAFKA-5239) Producer buffer pool allocates memory inside a lock.

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5239. -- Resolution: Fixed Assignee: Sean McCauliff Fix Version/s: 1.0.0 > Producer buffer pool a

Fault Injection

2017-08-22 Thread Colin McCabe
Hi all, I've been working on a fault injector for Apache Kafka. The general idea is to create faults such as network partitions or disk failures, and see what happens in the cluster. The fault injector can run as part of a ducktape system test, or standalone. The fault injector has two processe

[jira] [Resolved] (KAFKA-4823) Creating Kafka Producer on application running on Java older version

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4823. -- Resolution: Won't Fix Kafka Dropped support for Java 1.6 from 0.9 release. You can try Rest Proxy/Other

[jira] [Created] (KAFKA-5766) Very high CPU-load of consumer when broker is down

2017-08-22 Thread Sebastian Bernauer (JIRA)
Sebastian Bernauer created KAFKA-5766: - Summary: Very high CPU-load of consumer when broker is down Key: KAFKA-5766 URL: https://issues.apache.org/jira/browse/KAFKA-5766 Project: Kafka Is

Build failed in Jenkins: kafka-trunk-jdk7 #2664

2017-08-22 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5152: perform state restoration in poll loop -- [...truncated 915.54 KB...] kafka.server.ControlledShutdownLeaderSelectorTest > testSelectLe

Build failed in Jenkins: kafka-trunk-jdk8 #1933

2017-08-22 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5152: perform state restoration in poll loop -- [...truncated 920.92 KB...] kafka.integration.TopicMetadataTest > testGetAllTopicMetadata STA

[jira] [Resolved] (KAFKA-3927) kafka broker config docs issue

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3927. -- Resolution: Later Yes, These changes are done in KAFKA-615. Please reopen if the issue still exists.

[jira] [Resolved] (KAFKA-3800) java client can`t poll msg

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3800. -- Resolution: Cannot Reproduce Please reopen if the issue still exists. > java client can`t poll msg >

[jira] [Resolved] (KAFKA-3653) expose the queue size in ControllerChannelManager

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3653. -- Resolution: Fixed Fixed in KAFKA-5135/KIP-143 > expose the queue size in ControllerChannelManager > ---

Re: Fault Injection

2017-08-22 Thread Timothy Chen
Hi Colin, The Kibosh code is just a README for now, is it going to be published soon? Tim On Tue, Aug 22, 2017 at 11:44 AM, Colin McCabe wrote: > Hi all, > > I've been working on a fault injector for Apache Kafka. The general > idea is to create faults such as network partitions or disk failur

[GitHub] kafka pull request #3713: MINOR: simplify state transition for Kafka Streams...

2017-08-22 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3713 MINOR: simplify state transition for Kafka Streams and stream threads You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KM

[jira] [Resolved] (KAFKA-3139) JMX metric ProducerRequestPurgatory doesn't exist, docs seem wrong.

2017-08-22 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3139. -- Resolution: Fixed Fixed in KAFKA-4252 > JMX metric ProducerRequestPurgatory doesn't exist, docs seem wr

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-22 Thread Matthias J. Sax
Thanks to the update Damian! Couple of comments: KStream: leftJoin and outerJoin for KStream/KTable join should not have `JoinWindows` parameter Nit: TopologyBuilder -> Topology Nit: new class Serialized list static method #with twice WindowedKStream -> for consistency we should either have

Re: [DISCUSS] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-08-22 Thread Colin McCabe
Hi, Thanks for the KIP. It looks good overall. On Tue, Aug 22, 2017, at 08:54, Tom Bentley wrote: > Hi Jun, > > Thanks for the feedback. > > I've updated the KIP to mention this new algorithm, which I agree will be > much better from the AdminClient PoV. > > I've also reverted the authorizati

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-08-22 Thread Matthias J. Sax
Thanks for the update Jorge. I don't have any further comments. -Matthias On 8/12/17 6:43 PM, Jorge Esteban Quilcate Otoya wrote: > I have updated the KIP: > > - Change execution parameters, using `--dry-run` > - Reference KAFKA-4327 > - And advise about changes on `StreamResetter` > > Also i

Re: [DISCUSS] KIP-184 Rename LogCleaner and related classes to LogCompactor

2017-08-22 Thread Colin McCabe
Hmm. There are a lot of configuration keys that involve "log cleaner." It seems like if we rename this component, logically we'd have to rename all of them and support the old versions as deprecated config keys: val LogCleanupPolicyProp = "log.cleanup.policy" val LogCleanerThreadsProp = "log

[GitHub] kafka pull request #3714: close iterator on doc example

2017-08-22 Thread abbccdda
GitHub user abbccdda opened a pull request: https://github.com/apache/kafka/pull/3714 close iterator on doc example The iterator interface usage has some examples missing explicit close operation after usage. We should remind the user to do so because un-closed iterator will leave

[GitHub] kafka pull request #3715: KafkaService: print node hostname on failure

2017-08-22 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3715 KafkaService: print node hostname on failure Print node hostname on failure. Check for both "kafka.Kafka" and "metrics.SupportedKafka" process names. You can merge this pull request into a Git

[GitHub] kafka pull request #3716: KAFKA-5342: Clarify fatal/abortable exceptions use...

2017-08-22 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3716 KAFKA-5342: Clarify fatal/abortable exceptions used in producer You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-5342 Al

Re: [DISCUSS] KIP-189: Improve principal builder interface and add support for SASL

2017-08-22 Thread Jason Gustafson
Bump. I'll open a vote in a few days if there are no comments. Thanks, Jason On Sat, Aug 19, 2017 at 12:28 AM, Ismael Juma wrote: > Thanks for the KIP Jason. It seems reasonable and cleans up some > inconsistencies in that area. It would be great to get some feedback from > Mayuresh and others

Re: [DISCUSS] KIP-184 Rename LogCleaner and related classes to LogCompactor

2017-08-22 Thread Jason Gustafson
Hi Pranav, Yeah, I'd recommend closing it since the benefit is unclear and since no one has jumped in to offer stronger support for the change. Were you planning to do a KIP to deprecate `log.cleaner.enable`? I still think that makes sense. Thanks, Jason On Tue, Aug 22, 2017 at 1:47 PM, Colin Mc

Re: [DISCUSS] KIP-185: Make exactly once in order delivery per partition the default producer setting

2017-08-22 Thread Jason Gustafson
Thanks Apurva, On compatibility: I think the proposal makes sense. It's a pity that we can't support idempotence for 0.11.0.0 brokers in the "safe" mode even if it is supported by the broker. I can already imagine users complaining about this, but I guess it's the consequence of missing the impact

Re: [DISCUSS] KIP-179: Change ReassignPartitionsCommand to use AdminClient

2017-08-22 Thread Colin McCabe
On Wed, Aug 9, 2017, at 07:17, Tom Bentley wrote: > Hi Dong and Jun, > > Thanks again for your input in this discussion and on KIP-113. It's > difficult that discussion is split between this thread and the one for > KIP-113, but I'll try to respond on this thread to questions asked on > this > thr

[jira] [Created] (KAFKA-5767) Kafka server should halt if IBP < 1.0.0 and there is log directory failure

2017-08-22 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5767: --- Summary: Kafka server should halt if IBP < 1.0.0 and there is log directory failure Key: KAFKA-5767 URL: https://issues.apache.org/jira/browse/KAFKA-5767 Project: Kafka

[GitHub] kafka pull request #3717: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-22 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3717 KAFKA-5731 Corrected how the sink task worker updates the last committed offsets (0.10.2) Prior to this change, it was possible for the synchronous consumer commit request to be handled before previ

[GitHub] kafka pull request #3718: KAFKA-5767; Kafka server should halt if IBP < 1.0....

2017-08-22 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/3718 KAFKA-5767; Kafka server should halt if IBP < 1.0.0 and there is log directory failure You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindon

[GitHub] kafka pull request #3719: KAFKA-5603: Don't abort TX for zombie tasks

2017-08-22 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3719 KAFKA-5603: Don't abort TX for zombie tasks You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-5603-dont-abort-tx-for-zombie-tasks

[jira] [Created] (KAFKA-5768) Upgrade ducktape version to 0.7.0, and use new kill_java_processes

2017-08-22 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-5768: -- Summary: Upgrade ducktape version to 0.7.0, and use new kill_java_processes Key: KAFKA-5768 URL: https://issues.apache.org/jira/browse/KAFKA-5768 Project: Kafka

[jira] [Resolved] (KAFKA-2590) KIP-28: Kafka Streams Checklist

2017-08-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2590. -- Resolution: Fixed Assignee: Guozhang Wang > KIP-28: Kafka Streams Checklist >

[GitHub] kafka pull request #3720: [DO NOT MERGE] KAFKA-3705: non-key joins

2017-08-22 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3720 [DO NOT MERGE] KAFKA-3705: non-key joins This is just for reviewing the diff easily to see how it is done by @jfillipiak. You can merge this pull request into a Git repository by running:

[GitHub] kafka pull request #3721: Upgrade to ducktape 0.7.0

2017-08-22 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3721 Upgrade to ducktape 0.7.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/cmccabe/kafka KAFKA-5768 Alternatively you can review and apply these

[GitHub] kafka pull request #3722: KAFKA-5603: Don't abort TX for zombie tasks

2017-08-22 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3722 KAFKA-5603: Don't abort TX for zombie tasks You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-5603-dont-abort-tx-for-zombie-tasks

[GitHub] kafka pull request #3717: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-22 Thread rhauch
Github user rhauch closed the pull request at: https://github.com/apache/kafka/pull/3717 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-188 - Add new metrics to support health checks

2017-08-22 Thread Jun Rao
Hi, Rajini, Yes, if those error metrics are registered dynamically, we could worry about expiration later. Thanks, Jun On Fri, Aug 18, 2017 at 1:55 AM, Rajini Sivaram wrote: > Perhaps we could register dynamically for now. If we find that the cost of > retaining these is high, we can add the

[GitHub] kafka pull request #3723: KAFKA-5358: Consumer perf tool should count rebala...

2017-08-22 Thread huxihx
GitHub user huxihx opened a pull request: https://github.com/apache/kafka/pull/3723 KAFKA-5358: Consumer perf tool should count rebalance time. You can merge this pull request into a Git repository by running: $ git pull https://github.com/huxihx/kafka KAFKA-5358 Alternativel

[GitHub] kafka pull request #3188: KAFKA-5358: Consumer perf tool should count rebala...

2017-08-22 Thread huxihx
Github user huxihx closed the pull request at: https://github.com/apache/kafka/pull/3188 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

2017-08-22 Thread Becket Qin
In general max.message.delivery.wait.ms is a cleaner approach. That would make the guarantee clearer. That said, there seem subtleties in some scenarios: 1. I agree with Sumante that it is a little weird that a message could be expired immediately if it happens to enter a batch that is about to be