Re: [DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

Thanks for the KIP Mickael. I suggest starting a vote. Ismael On Mon, Aug 21, 2017 at 2:51 PM, Mickael Maison wrote: > Hi all, > > I have created a KIP to cleanup the way client-ids are handled by > brokers and clients. > > Currently the Java clients have some restrictions on the client-ids > t

[VOTE] KIP-190: Handle client-ids consistently between clients and brokers

Hi, I'd like to start the vote on KIP-190: https://cwiki.apache.org/confluence/display/KAFKA/KIP-190%3A+Handle+client-ids+consistently+between+clients+and+brokers Thanks

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

Thanks for the KIP. +1 (binding) from me. Because this is a bug fix, the change is simple and the impact can be bad, I suggest considering this for the 1.0.0 release. Guozhang's call though. Ismael On Thu, Sep 14, 2017 at 9:52 AM, Mickael Maison wrote: > Hi, > > I'd like to start the vote on K

Re: [DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

Hi Mickael, I was just wondering why the restriction was imposed for Java clients the first place, do you know? Cheers, Tom On 14 September 2017 at 09:16, Ismael Juma wrote: > Thanks for the KIP Mickael. I suggest starting a vote. > > Ismael > > On Mon, Aug 21, 2017 at 2:51 PM, Mickael Maison

[GitHub] kafka pull request #3795: KAFKA-5783: Add KafkaPrincipalBuilder with support...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3795 ---

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

+1 (non-binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Ismael Juma To: dev@kafka.apache.org Date: 14/09/2017 09:56 Subject:Re: [VOTE] KIP-190: Handle client-ids consistently between clients a

[GitHub] kafka pull request #2546: KAFKA-4764: Improve diagnostics for SASL auth fail...

Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/2546 ---

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

+1 (binding) Thank you for the KIP, Mickael. On Thu, Sep 14, 2017 at 10:24 AM, Edoardo Comar wrote: > +1 (non-binding) > -- > > Edoardo Comar > > IBM Message Hub > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > From: Ismael Juma > To: dev@kaf

[GitHub] kafka pull request #3856: MINOR: Remove unused SecurityProtocol.TRACE

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3856 MINOR: Remove unused SecurityProtocol.TRACE It adds complexity for no benefit since we don't use it anywhere. Also removed a few unused imports, variables and default parameters. You

[GitHub] kafka pull request #3854: MINOR: Fix LogContext message format in KafkaProdu...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3854 ---

[GitHub] kafka pull request #3852: MINOR: Update TransactionManager to use LogContext

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3852 ---

[GitHub] kafka pull request #3857: MINOR: Bump version in streams quickstart archetyp...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3857 MINOR: Bump version in streams quickstart archetype pom.xml You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka fix-archetype-version Alter

[GitHub] kafka pull request #3858: MINOR: update docs to add note about removing SNAP...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3858 MINOR: update docs to add note about removing SNAPSHOT from streams dependency You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka docs Al

[GitHub] kafka pull request #3857: MINOR: Bump version in streams quickstart archetyp...

Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/3857 ---

[jira] [Created] (KAFKA-5890) records.lag should use tags for topic and partition rather than using metric name.

Charly Molter created KAFKA-5890: Summary: records.lag should use tags for topic and partition rather than using metric name. Key: KAFKA-5890 URL: https://issues.apache.org/jira/browse/KAFKA-5890 Proj

[jira] [Created] (KAFKA-5891) Cast transformation fails if record schema contains timestamp field

Artem Plotnikov created KAFKA-5891: -- Summary: Cast transformation fails if record schema contains timestamp field Key: KAFKA-5891 URL: https://issues.apache.org/jira/browse/KAFKA-5891 Project: Kafka

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

+1 for me on collapsing the Rich and ValueWithKey interfaces into 1 interface. Thanks, Bill On Wed, Sep 13, 2017 at 11:31 AM, Jeyhun Karimov wrote: > Hi Damian, > > Thanks for your feedback. Actually, this (what you propose) was the first > idea of KIP-149. Then we decided to divide it

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

+1 One interface is cleaner. On Thu, Sep 14, 2017 at 7:26 AM, Bill Bejeck wrote: > +1 for me on collapsing the Rich and ValueWithKey interfaces into 1 > interface. > > Thanks, > Bill > > On Wed, Sep 13, 2017 at 11:31 AM, Jeyhun Karimov > wrote: > > > Hi Damian, > > > > Thanks for your

[jira] [Created] (KAFKA-5892) Connector property override does not work unless setting ALL converter properties

Yeva Byzek created KAFKA-5892: - Summary: Connector property override does not work unless setting ALL converter properties Key: KAFKA-5892 URL: https://issues.apache.org/jira/browse/KAFKA-5892 Project: Ka

QA bot has stalled

Hi, I logged INFRA-15084 . FYI

Jenkins build is back to normal : kafka-trunk-jdk7 #2759

See

Build failed in Jenkins: kafka-trunk-jdk8 #2019

See Changes: [rajinisivaram] KAFKA-5783; Add KafkaPrincipalBuilder with support for SASL (KIP-189) [ismael] MINOR: Fix LogContext message format in KafkaProducer [ismael] MINOR: Update TransactionManager to us

Build failed in Jenkins: kafka-trunk-jdk9 #9

See Changes: [rajinisivaram] KAFKA-5783; Add KafkaPrincipalBuilder with support for SASL (KIP-189) [ismael] MINOR: Fix LogContext message format in KafkaProducer [ismael] MINOR: Update TransactionManager to use L

[jira] [Created] (KAFKA-5893) ResetIntegrationTest fails

Matthias J. Sax created KAFKA-5893: -- Summary: ResetIntegrationTest fails Key: KAFKA-5893 URL: https://issues.apache.org/jira/browse/KAFKA-5893 Project: Kafka Issue Type: Bug Compon

[GitHub] kafka pull request #3859: KAFKA-5893: ResetIntegrationTest fails

GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3859 KAFKA-5893: ResetIntegrationTest fails - improve stderr output for better debugging You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka ka

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

+1. Thanks for the KIP. On Thu, Sep 14, 2017 at 2:33 AM, Rajini Sivaram wrote: > +1 (binding) > > Thank you for the KIP, Mickael. > > On Thu, Sep 14, 2017 at 10:24 AM, Edoardo Comar wrote: > > > +1 (non-binding) > > -- > > > > Edoardo Comar > > >

[jira] [Created] (KAFKA-5894) add the notion of max inflight requests to async ZookeeperClient

Onur Karaman created KAFKA-5894: --- Summary: add the notion of max inflight requests to async ZookeeperClient Key: KAFKA-5894 URL: https://issues.apache.org/jira/browse/KAFKA-5894 Project: Kafka

[GitHub] kafka pull request #3860: KAFKA-5894: add the notion of max inflight request...

GitHub user onurkaraman opened a pull request: https://github.com/apache/kafka/pull/3860 KAFKA-5894: add the notion of max inflight requests to async ZookeepeeperClient ZookeeperClient is a zookeeper client that encourages pipelined requests to zookeeper. We want to add the notion

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

This KIP has three binding votes already but we need to wait 72 hours for the voting thread to complete. I'd take it as "tentative accepted" for 1.0.0 unless someone has a -1 vote before the voting is closed. Guozhang On Thu, Sep 14, 2017 at 10:28 AM, Jason Gustafson wrote: > +1. Thanks for th

[jira] [Created] (KAFKA-5895) Update readme to reflect that Gradle 2 is no longer good enough

Matthias Weßendorf created KAFKA-5895: - Summary: Update readme to reflect that Gradle 2 is no longer good enough Key: KAFKA-5895 URL: https://issues.apache.org/jira/browse/KAFKA-5895 Project: Kafk

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

+1 (binding) On Thu, Sep 14, 2017 at 11:25 AM Guozhang Wang wrote: > This KIP has three binding votes already but we need to wait 72 hours for > the voting thread to complete. I'd take it as "tentative accepted" for > 1.0.0 unless someone has a -1 vote before the voting is closed. > > > Guozhang

[GitHub] kafka pull request #3861: KAFKA-5895

GitHub user matzew opened a pull request: https://github.com/apache/kafka/pull/3861 KAFKA-5895 As discussed in [KAFKA-5895](https://issues.apache.org/jira/browse/KAFKA-5895), this trivial PR is simply adding a hint that Gradle 3.0+ is now needed You can merge this pull request in

[jira] [Created] (KAFKA-5896) Kafka Connect task threads never interrupted

Nick Pillitteri created KAFKA-5896: -- Summary: Kafka Connect task threads never interrupted Key: KAFKA-5896 URL: https://issues.apache.org/jira/browse/KAFKA-5896 Project: Kafka Issue Type: Bu

1.0.0 Feature Freeze Update

Hello folks, This is a heads up on 1.0.0 progress post the KIP-deadline: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71764913 In this release we have a total of 33 KIPs either newly adopted or inherited from the previous release. Among them 15 KIPs has been merged to trunk,

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

I'd suggest we remove both to and through together in KIP-182, since for operator "KTable#to" is as confusing as to "KTable#through" which overwhelms its benefit as a syntax sugar. I think the extra step "toStream" is actually better to remind the caller that it is sending its changelog stream to t

[jira] [Created] (KAFKA-5897) The producerId can be reset unnecessarily

Apurva Mehta created KAFKA-5897: --- Summary: The producerId can be reset unnecessarily Key: KAFKA-5897 URL: https://issues.apache.org/jira/browse/KAFKA-5897 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

Hi, Mickael, Thanks for the KIP. +1 from me. Jun On Thu, Sep 14, 2017 at 1:52 AM, Mickael Maison wrote: > Hi, > > I'd like to start the vote on KIP-190: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 190%3A+Handle+client-ids+consistently+between+clients+and+brokers > > Thanks >

[GitHub] kafka pull request #3862: DOCS-90 - Add navigation to Streams doc

GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka/pull/3862 DOCS-90 - Add navigation to Streams doc You can merge this pull request into a Git repository by running: $ git pull https://github.com/joel-hamill/kafka joel-hamill/streams-dev-guide Al

[GitHub] kafka-site pull request #76: DOCS-90 - Add streams child topics to left-hand...

GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka-site/pull/76 DOCS-90 - Add streams child topics to left-hand nav https://confluentinc.atlassian.net/browse/DOCS-90 You can merge this pull request into a Git repository by running: $ git pull https:/

[GitHub] kafka-site pull request #76: DOCS-90 - Add streams child topics to left-hand...

Github user joel-hamill closed the pull request at: https://github.com/apache/kafka-site/pull/76 ---

[GitHub] kafka-site pull request #77: DOCS-90 - Add streams child topics to left-hand...

GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka-site/pull/77 DOCS-90 - Add streams child topics to left-hand nav https://confluentinc.atlassian.net/browse/DOCS-90 You can merge this pull request into a Git repository by running: $ git pull https:/

[GitHub] kafka pull request #3856: MINOR: Remove unused SecurityProtocol.TRACE

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3856 ---

[GitHub] kafka pull request #3863: MINOR: Use SecurityProtocol in AuthenticationConte...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3863 MINOR: Use SecurityProtocol in AuthenticationContext Since we removed the unused `TRACE` option from `SecurityProtocol`, it now seems safer to expose it from `AuthenticationContext`. Additionally

[GitHub] kafka-site issue #77: DOCS-90 - Add streams child topics to left-hand nav

Github user joel-hamill commented on the issue: https://github.com/apache/kafka-site/pull/77 ping for review @guozhangwang @dguy ---

Jenkins build is back to normal : kafka-trunk-jdk9 #10

See

Build failed in Jenkins: kafka-trunk-jdk7 #2760

See Changes: [jason] MINOR: Remove unused SecurityProtocol.TRACE -- [...truncated 931.17 KB...] kafka.server.ServerGenerateBrokerIdTest > testAutoGenerateBrokerId PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #2020

See Changes: [jason] MINOR: Remove unused SecurityProtocol.TRACE -- [...truncated 2.54 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest > testNoMes

Please grant me Wiki Access

Hi, Please grant me wiki page access. I need the access to create a KIP for change . my wiki id is 'chetna' . -- Thanks and Regards, Chetna Chaudhari

Re: Please grant me Wiki Access

Hi, Chetna, Thanks for your interest. Just gave you the wiki permission. Jun On Thu, Sep 14, 2017 at 2:48 PM, chetna chaudhari wrote: > Hi, >Please grant me wiki page access. I need the access to create a KIP for > change . > my wiki id is 'chetn

[jira] [Created] (KAFKA-5898) Client consume more than one time a message

Cyril WIRTH created KAFKA-5898: -- Summary: Client consume more than one time a message Key: KAFKA-5898 URL: https://issues.apache.org/jira/browse/KAFKA-5898 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-196: Add metrics to Kafka Connect framework

On the advice of Ismael, I made a few minor changes to a few of the metrics to adhere to the new pattern of `-rate` and `-total` metric pairs defined in KIP-187 [1]: 1. Several of the "-rate" metrics were paired with a "-count" metric; the "-count" metrics were renamed to "-total". 2. Two "-rate"

[jira] [Created] (KAFKA-5899) Create Connect metrics for connectors

Randall Hauch created KAFKA-5899: Summary: Create Connect metrics for connectors Key: KAFKA-5899 URL: https://issues.apache.org/jira/browse/KAFKA-5899 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-5901) Create Connect metrics for source tasks

Randall Hauch created KAFKA-5901: Summary: Create Connect metrics for source tasks Key: KAFKA-5901 URL: https://issues.apache.org/jira/browse/KAFKA-5901 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-5903) Create Connect metrics for workers

Randall Hauch created KAFKA-5903: Summary: Create Connect metrics for workers Key: KAFKA-5903 URL: https://issues.apache.org/jira/browse/KAFKA-5903 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-5904) Create Connect metrics for worker rebalances

Randall Hauch created KAFKA-5904: Summary: Create Connect metrics for worker rebalances Key: KAFKA-5904 URL: https://issues.apache.org/jira/browse/KAFKA-5904 Project: Kafka Issue Type: Sub-ta

[jira] [Created] (KAFKA-5902) Create Connect metrics for sink tasks

Randall Hauch created KAFKA-5902: Summary: Create Connect metrics for sink tasks Key: KAFKA-5902 URL: https://issues.apache.org/jira/browse/KAFKA-5902 Project: Kafka Issue Type: Sub-task

[GitHub] kafka pull request #3864: KAFKA-5899 Added Connect metrics for connectors

GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3864 KAFKA-5899 Added Connect metrics for connectors Added metrics for each connector using Kafka’s existing `Metrics` framework. Since this is the first of several changes to add several groups of met

[jira] [Created] (KAFKA-5900) Create Connect metrics common to source and sink tasks

Randall Hauch created KAFKA-5900: Summary: Create Connect metrics common to source and sink tasks Key: KAFKA-5900 URL: https://issues.apache.org/jira/browse/KAFKA-5900 Project: Kafka Issue Ty

[GitHub] kafka pull request #3686: KAFKA-5738: Add cumulative count for rate metrics ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3686 ---

[GitHub] kafka pull request #3743: KAFKA-5494: enable idempotence with max.in.flight....

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3743 ---

Build failed in Jenkins: kafka-trunk-jdk9 #11

See Changes: [ismael] KAFKA-5738; Add cumulative count for rate metrics (KIP-187) [jason] KAFKA-5494; Enable idempotence with -- [...truncated 1.01 MB...] org.apache.kafka.

[jira] [Created] (KAFKA-5905) Remove PrincipalBuilder and DefaultPrincipalBuilder

Jason Gustafson created KAFKA-5905: -- Summary: Remove PrincipalBuilder and DefaultPrincipalBuilder Key: KAFKA-5905 URL: https://issues.apache.org/jira/browse/KAFKA-5905 Project: Kafka Issue T

Build failed in Jenkins: kafka-trunk-jdk8 #2021

See Changes: [ismael] KAFKA-5738; Add cumulative count for rate metrics (KIP-187) -- [...truncated 2.04 MB...] org.apache.kafka.common.security.auth.DefaultKafkaPrincipalB

[jira] [Reopened] (KAFKA-5792) Transient failure in KafkaAdminClientTest.testHandleTimeout

[ https://issues.apache.org/jira/browse/KAFKA-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reopened KAFKA-5792: Still seeing this: https://builds.apache.org/blue/organizations/jenkins/kafka-trunk-jdk8/detail

Build failed in Jenkins: kafka-trunk-jdk7 #2761

See Changes: [ismael] KAFKA-5738; Add cumulative count for rate metrics (KIP-187) -- [...truncated 2.52 MB...] org.apache.kafka.streams.integration.QueryableStateIntegrati

[GitHub] kafka-site pull request #78: MINOR: Add header items

GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka-site/pull/78 MINOR: Add header items You can merge this pull request into a Git repository by running: $ git pull https://github.com/joel-hamill/kafka-site joel-hamill/header-nav Alternatively you

[GitHub] kafka-site issue #78: MINOR: Add header items

Github user joel-hamill commented on the issue: https://github.com/apache/kafka-site/pull/78 ping for review @guozhangwang @dguy ---

[GitHub] kafka pull request #3778: KAFKA-5822: Consistent log formatting of topic par...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3778 ---

[jira] [Resolved] (KAFKA-5822) Consistent logging of topic partitions

[ https://issues.apache.org/jira/browse/KAFKA-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5822. Resolution: Fixed Fix Version/s: 1.0.0 > Consistent logging of topic partitions > ---

Build failed in Jenkins: kafka-trunk-jdk8 #2022

See Changes: [jason] KAFKA-5494; Enable idempotence with -- [...truncated 2.05 MB...] org.apache.kafka.common.security.auth.DefaultKafkaPrincipalBuilderTest > testPrincip

[GitHub] kafka pull request #3865: KAFKA-5793: Tighten up the semantics of the OutOfO...

GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/3865 KAFKA-5793: Tighten up the semantics of the OutOfOrderSequenceException *WIP : Don't review yet, still to add tests* Description of the solution can be found here: https://cwiki.apache.org/

Build failed in Jenkins: kafka-trunk-jdk7 #2762

See Changes: [jason] KAFKA-5494; Enable idempotence with -- [...truncated 2.53 MB...] org.apache.kafka.streams.integration.QueryableStateIntegrationTest > shouldBeAbleToQ

Build failed in Jenkins: kafka-trunk-jdk8 #2023

See Changes: [ismael] KAFKA-5822; Consistent log formatting of topic partitions -- [...truncated 2.54 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTe

[GitHub] kafka pull request #3866: KAFKA-5874: TopicCommand should check at least one...

GitHub user huxihx opened a pull request: https://github.com/apache/kafka/pull/3866 KAFKA-5874: TopicCommand should check at least one parameter is given... When altering topics, TopicCommand should ensure that at least one of parameters in `partitions`, `config` or `delete-config`

Kip Write Access

Hello, I wish to write a kip. Could you grant me access? Thanks (Wiki username is yohan.richard.yu)

system test builder

Hi, When I put the following in the address bar of Chrome: https://jenkins.confluent.io/job/system-test-kafka-branch-builder I was told: This site can’t be reached Are the tests accessible by the public ? Thanks

Jenkins build is back to normal : kafka-trunk-jdk9 #12

See

[GitHub] kafka pull request #3842: KAFKA-5301 Improve exception handling on consumer ...

Github user ConcurrencyPractitioner closed the pull request at: https://github.com/apache/kafka/pull/3842 ---

Build failed in Jenkins: kafka-trunk-jdk7 #2763

See Changes: [ismael] KAFKA-5822; Consistent log formatting of topic partitions -- [...truncated 931.92 KB...] kafka.server.ServerGenerateBrokerIdTest > testMultipleLogDi

MetricsReporter Does Not Receive Auto-generated Client Id

Hi, Is there a particular reason why the MetricsReporter class's configure() call is not guaranteed to receive the client id? The interceptors' configure() methods are guaranteed to have client id field (either user specified or the kafka auto generated client id such as producer-1). We are impl

Re: MetricsReporter Does Not Receive Auto-generated Client Id

Hi, I think there is no specific reason. we can pass the clientId to MetricsReporter class's configure() method. Can you pls raise the JIRA? On Fri, Sep 15, 2017 at 7:44 AM, Kevin Lu wrote: > Hi, > > Is there a particular reason why the MetricsReporter class's configure() > call is not guarante

[jira] [Created] (KAFKA-5906) Change metric.reporters configuration key to metrics.reporters to be consistent

Kevin Lu created KAFKA-5906: --- Summary: Change metric.reporters configuration key to metrics.reporters to be consistent Key: KAFKA-5906 URL: https://issues.apache.org/jira/browse/KAFKA-5906 Project: Kafka

[GitHub] kafka pull request #3867: MINOR: Change metric.reporters description to use ...

GitHub user KevinLiLu opened a pull request: https://github.com/apache/kafka/pull/3867 MINOR: Change metric.reporters description to use actual MetricsReporter.class name The `metric.reporters` description in the documentation says to implement the `MetricReporter`, but the actual