[jira] [Created] (KAFKA-8060) The Kafka protocol generator should allow null default values for strings

2019-03-07 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-8060: -- Summary: The Kafka protocol generator should allow null default values for strings Key: KAFKA-8060 URL: https://issues.apache.org/jira/browse/KAFKA-8060 Project:

[jira] [Resolved] (KAFKA-7974) KafkaAdminClient loses worker thread/enters zombie state when initial DNS lookup fails

2019-03-07 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe resolved KAFKA-7974. Resolution: Fixed Fix Version/s: 2.2.0 > KafkaAdminClient loses worker thread/enters

Re: Apache Kafka Memory Leakage???

2019-03-07 Thread Syed Mudassir Ahmed
Sonke, I am actually developer at snaplogic. I contacted my platform/backend team. They said the memory allocation figure shown in the UI just tells the total amount of memory allocated since the execution. It doesn't consider the memory reclaimed or garbage-collected. We need not worry abou

[jira] [Created] (KAFKA-8061) Use forceClose flag to check in the loop inside maybeWaitForProducerId.

2019-03-07 Thread Manikumar (JIRA)
Manikumar created KAFKA-8061: Summary: Use forceClose flag to check in the loop inside maybeWaitForProducerId. Key: KAFKA-8061 URL: https://issues.apache.org/jira/browse/KAFKA-8061 Project: Kafka

[jira] [Resolved] (KAFKA-8018) Flaky Test SaslSslAdminClientIntegrationTest#testLegacyAclOpsNeverAffectOrReturnPrefixed

2019-03-07 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-8018. -- Resolution: Fixed > Flaky Test > SaslSslAdminClientIntegrationTest#testLegacyAclOpsNeverAffectOrReturn

[jira] [Resolved] (KAFKA-8039) Flaky Test SaslAuthenticatorTest#testCannotReauthenticateAgainFasterThanOneSecond

2019-03-07 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8039. --- Resolution: Fixed Reviewer: Ron Dagostino > Flaky Test > SaslAuthenticatorTest#testCan

Jenkins build is back to normal : kafka-2.2-jdk8 #47

2019-03-07 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #3441

2019-03-07 Thread Apache Jenkins Server
See Changes: [colin] Fix for KAFKA-7974: Avoid zombie AdminClient when node host isn't -- [...truncated 4.55 MB...] kafka.server.MetadataCacheTest > getTopicMetadataPartit

[jira] [Created] (KAFKA-8062) StateListener is not notified when StreamThread dies

2019-03-07 Thread Andrey Volkov (JIRA)
Andrey Volkov created KAFKA-8062: Summary: StateListener is not notified when StreamThread dies Key: KAFKA-8062 URL: https://issues.apache.org/jira/browse/KAFKA-8062 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-7950) Kafka tools GetOffsetShell -time description

2019-03-07 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7950. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 6357 [https://github.com/a

[jira] [Resolved] (KAFKA-8036) Log dir reassignment on followers fails with FileNotFoundException for the leader epoch cache on leader election

2019-03-07 Thread Stanislav Kozlovski (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski resolved KAFKA-8036. Resolution: Fixed I was wrong. After writing a test to verify the behavior ([https

[jira] [Resolved] (KAFKA-7977) Flaky Test ReassignPartitionsClusterTest#shouldOnlyThrottleMovingReplicas

2019-03-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7977. Resolution: Fixed The PR in KAFKA-8018 is merged, which should reduce the chance for ZK session expiration

[jira] [Resolved] (KAFKA-8022) Flaky Test RequestQuotaTest#testExemptRequestTime

2019-03-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-8022. Resolution: Fixed Fix Version/s: (was: 0.11.0.4) 2.2.1 2.3.

[jira] [Created] (KAFKA-8063) Flaky Test WorkerTest#testConverterOverrides

2019-03-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8063: -- Summary: Flaky Test WorkerTest#testConverterOverrides Key: KAFKA-8063 URL: https://issues.apache.org/jira/browse/KAFKA-8063 Project: Kafka Issue Type: Bu

Build failed in Jenkins: kafka-trunk-jdk8 #3442

2019-03-07 Thread Apache Jenkins Server
See Changes: [manikumar] KAFKA-8018: Flaky Test [github] KAFKA-8039 - Use MockTime in fast reauth test to avoid transient -- [...truncated 4.66 MB...] org.apache.kafka.s

Re: [VOTE] 2.2.0 RC1

2019-03-07 Thread Jonathan Santilli
Hello Matthias, I have run the tests without issue. Also, I have performed the quick start successfully, thanks for the release. Cheers! -- Jonathan On Wed, Mar 6, 2019 at 8:58 PM Matthias J. Sax wrote: > Thanks for testing the RC Jakub! > > I agree, that both issue are no reason to cancel t

Re: [VOTE] KIP-436 Add a metric indicating start time

2019-03-07 Thread Colin McCabe
+1 (binding). Thanks, Stanislav. best, Colin On Tue, Mar 5, 2019, at 05:23, Stanislav Kozlovski wrote: > Hey everybody, > > I'd like to start a vote thread about the lightweight KIP-436 > KIP: KIP-436 >

Re: [VOTE] KIP-436 Add a metric indicating start time

2019-03-07 Thread Manikumar
+1 (binding). Thanks for the KIP. Thanks, Manikumar On Thu, Mar 7, 2019 at 11:52 PM Colin McCabe wrote: > +1 (binding). > > Thanks, Stanislav. > > best, > Colin > > On Tue, Mar 5, 2019, at 05:23, Stanislav Kozlovski wrote: > > Hey everybody, > > > > I'd like to start a vote thread about the l

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-03-07 Thread Stanislav Kozlovski
Thanks for the KIP, Kevin! This change will be a good improvement to Kafka's observability story +1 (non-binding) On Thu, Mar 7, 2019 at 4:49 AM Vahid Hashemian wrote: > Thanks for the KIP Kevin. > > +1 (binding) > > --Vahid > > On Wed, Mar 6, 2019 at 8:39 PM Dongjin Lee wrote: > > > +1 (non-b

[jira] [Resolved] (KAFKA-7288) Transient failure in SslSelectorTest.testCloseConnectionInClosingState

2019-03-07 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7288. --- Resolution: Fixed Fix Version/s: (was: 2.1.0) 2.2.1 > Transient

[jira] [Created] (KAFKA-8064) Flaky Test DeleteTopicTest #testRecreateTopicAfterDeletion

2019-03-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8064: -- Summary: Flaky Test DeleteTopicTest #testRecreateTopicAfterDeletion Key: KAFKA-8064 URL: https://issues.apache.org/jira/browse/KAFKA-8064 Project: Kafka

[jira] [Created] (KAFKA-8065) Forwarding modified timestamps does not reset timestamp correctly

2019-03-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8065: -- Summary: Forwarding modified timestamps does not reset timestamp correctly Key: KAFKA-8065 URL: https://issues.apache.org/jira/browse/KAFKA-8065 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #3443

2019-03-07 Thread Apache Jenkins Server
See Changes: [manikumar] KAFKA-7950; Update description for the "time" parameter for -- [...truncated 2.34 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shou

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-03-07 Thread Guozhang Wang
Hi Konstantine, Thanks for the updated KIP and the PR as well (which is huge :) I briefly looked through it as well as the KIP, and I have one minor comment to add (otherwise I'm binding +1 on it as well) about the backward compatibility. I'll use one example to illustrate the issue: 1) Suppose y

[jira] [Created] (KAFKA-8066) ReplicaFetcherThread fails to startup because of failing to register the metric.

2019-03-07 Thread Zhanxiang (Patrick) Huang (JIRA)
Zhanxiang (Patrick) Huang created KAFKA-8066: Summary: ReplicaFetcherThread fails to startup because of failing to register the metric. Key: KAFKA-8066 URL: https://issues.apache.org/jira/browse/KAFKA-

[jira] [Reopened] (KAFKA-5141) WorkerTest.testCleanupTasksOnStop transient failure due to NPE

2019-03-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5141: This happened again: [https://builds.apache.org/blue/organizations/jenkins/kafka-trunk-jdk8/de

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-03-07 Thread Konstantine Karantasis
Thanks Guozhang. This is a valid observation regarding the current status of the PR. I updated the KIP to explicitly call out how the downgrade process should work in the section Compatibility, Deprecation, and Migration. Additionally, I reduced the configuration modes for the connect.protocol to

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-03-07 Thread Guozhang Wang
Thanks Konstantine, I've read the updated section on https://cwiki.apache.org/confluence/display/KAFKA/KIP-415%3A+Incremental+Cooperative+Rebalancing+in+Kafka+Connect and it lgtm. I'm +1 on the KIP. Guozhang On Thu, Mar 7, 2019 at 2:35 PM Konstantine Karantasis < konstant...@confluent.io> wrot

[jira] [Created] (KAFKA-8067) JsonConverter missing and optional field defaults result in a null pointer

2019-03-07 Thread Eric Pheatt (JIRA)
Eric Pheatt created KAFKA-8067: -- Summary: JsonConverter missing and optional field defaults result in a null pointer Key: KAFKA-8067 URL: https://issues.apache.org/jira/browse/KAFKA-8067 Project: Kafka

Build failed in Jenkins: kafka-2.2-jdk8 #49

2019-03-07 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7288 - Make sure no bytes buffered when relying on idle timeout in -- [...truncated 2.69 MB...] kafka.security.auth.ZkAuthorizationTest > t

[jira] [Resolved] (KAFKA-8061) Handle concurrent ProducerId reset and call to Sender thread shutdown

2019-03-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8061. Resolution: Fixed Fix Version/s: 2.2.1 2.1.2 2.

[jira] [Created] (KAFKA-8068) Flaky Test DescribeConsumerGroupTest#testDescribeMembersOfExistingGroup

2019-03-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8068: -- Summary: Flaky Test DescribeConsumerGroupTest#testDescribeMembersOfExistingGroup Key: KAFKA-8068 URL: https://issues.apache.org/jira/browse/KAFKA-8068 Project: Ka

Jenkins build is back to normal : kafka-trunk-jdk8 #3444

2019-03-07 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-7831) Consumer SubscriptionState missing synchronization

2019-03-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7831. Resolution: Fixed Fix Version/s: 2.3.0 > Consumer SubscriptionState missing synchron

[jira] [Resolved] (KAFKA-7764) Authentication exceptions during consumer metadata updates may not get propagated

2019-03-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7764. Resolution: Fixed This was fixed by the patch for KAFKA-7831 which removes the metadata lis

Streams Meetup at LinkedIn Sunnyvale, 6pm, Wednesday, March 20, 2019

2019-03-07 Thread Joel Koshy
*[bcc: (users,dev)@kafka.apache.org ]* Hi everyone, The Streams Infrastructure team at LinkedIn invites you to attend a Streams Processing meetup on Wednesday, March 20 at LinkedIn’s Sunnyvale campus. (This meetup focuses on Apache Kafka, Apache Samza, and related streami

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2019-03-07 Thread Guozhang Wang
One more thought regarding *c-P2: Duplicates)*: first I want to separate this issue with the more general issue that today (not only foreign-key, but also co-partition primary-key) table-table joins is still not strictly respecting the timestamp ordering since the two changelog streams may be fetch

Build failed in Jenkins: kafka-2.0-jdk8 #237

2019-03-07 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8061; Handle concurrent ProducerId reset and call to Sender thread -- [...truncated 437.06 KB...] kafka.security.auth.SimpleAclAuthorizerTest > te

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

2019-03-07 Thread hacker win7
+1 (non-binding) > On Mar 8, 2019, at 02:32, Stanislav Kozlovski wrote: > > Thanks for the KIP, Kevin! This change will be a good improvement to > Kafka's observability story > > +1 (non-binding) > > On Thu, Mar 7, 2019 at 4:49 AM Vahid Hashemian > wrote: > >> Thanks for the KIP Kevin. >> >

Build failed in Jenkins: kafka-trunk-jdk8 #3445

2019-03-07 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8061; Handle concurrent ProducerId reset and call to Sender thread [bbejeck] Improve API docs of (flatT|t)ransform (#6365) [wangguoz] Minor resolve streams scala warnings (#6369) ---

Build failed in Jenkins: kafka-trunk-jdk11 #351

2019-03-07 Thread Apache Jenkins Server
See Changes: [github] KAFKA-7831; Do not modify subscription state from background thread -- [...truncated 2.33 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-8060) The Kafka protocol generator should allow null default values for strings

2019-03-07 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-8060. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 6387 [https://github.com/a

Jenkins build is back to normal : kafka-2.2-jdk8 #50

2019-03-07 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-8069) Committed offsets get cleaned up right after the coordinator loading them back from __consumer_offsets in broker with old inter-broker protocol version (< 2.2)

2019-03-07 Thread Zhanxiang (Patrick) Huang (JIRA)
Zhanxiang (Patrick) Huang created KAFKA-8069: Summary: Committed offsets get cleaned up right after the coordinator loading them back from __consumer_offsets in broker with old inter-broker protocol version (< 2.2) Ke

Re: [VOTE] KIP-436 Add a metric indicating start time

2019-03-07 Thread Satish Duggana
Thanks for the KIP, +1 (non-binding) ~Satish. On Thu, Mar 7, 2019 at 11:58 PM Manikumar wrote: > +1 (binding). > > Thanks for the KIP. > > Thanks, > Manikumar > > > On Thu, Mar 7, 2019 at 11:52 PM Colin McCabe wrote: > > > +1 (binding). > > > > Thanks, Stanislav. > > > > best, > > Colin > > >

Jenkins build is back to normal : kafka-trunk-jdk11 #352

2019-03-07 Thread Apache Jenkins Server
See