[GitHub] kafka pull request #4101: MINOR: Add missing ";" to example jaas configuarti...

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/4101 MINOR: Add missing ";" to example jaas configuartion You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka SCRAM-DOCS Alternatively y

Build failed in Jenkins: kafka-trunk-jdk7 #2909

See Changes: [me] MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags -- [...truncated 380.77 KB...] kafka.api.SaslPlainSslEndToEndAuthorizationTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2153

See Changes: [junrao] KAFKA-6071; Use ZookeeperClient in LogManager -- [...truncated 3.70 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest > testSho

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

Jenkins build is back to normal : kafka-trunk-jdk9 #140

See

Re: [VOTE] 1.0.0 RC2

Sent the email too quick.. The filed blocker JIRA is this one: https://issues.apache.org/jira/browse/KAFKA-6093 Guozhang On Thu, Oct 19, 2017 at 8:58 PM, Guozhang Wang wrote: > Vahid, > > Thanks for testing the RC! Really appreciate it. > > Could you file another JIRA for the Streams quickstar

Re: [VOTE] 1.0.0 RC2

Vahid, Thanks for testing the RC! Really appreciate it. Could you file another JIRA for the Streams quickstart issue on Windows? Folks, While working on a flaky unit test we happen to find a topic-deletion issue (https://github.com/apache/kafka/pull/4095), marked as a blocker for the release.

Build failed in Jenkins: kafka-1.0-jdk7 #47

See Changes: [me] MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags -- [...truncated 368.59 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldU

Jenkins build is back to normal : kafka-trunk-jdk7 #2908

See

[GitHub] kafka pull request #4100: KAFKA-6093; log.close() should not prevent log fro...

GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/4100 KAFKA-6093; log.close() should not prevent log from being accessed You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-6093

[GitHub] kafka pull request #4099: MINOR: Use ObjectName.quote instead of URL-encodin...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4099 ---

[jira] [Resolved] (KAFKA-6071) Use ZookeeperClient in LogManager

[ https://issues.apache.org/jira/browse/KAFKA-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-6071. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4089 [https://github.com/apache

[GitHub] kafka pull request #4089: KAFKA-6071: Use ZookeeperClient in LogManager

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4089 ---

[jira] [Created] (KAFKA-6094) transient failure in testMultipleMarkersOneLeader

Jun Rao created KAFKA-6094: -- Summary: transient failure in testMultipleMarkersOneLeader Key: KAFKA-6094 URL: https://issues.apache.org/jira/browse/KAFKA-6094 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-6093) replica dir not deleted after topic deletion

Jun Rao created KAFKA-6093: -- Summary: replica dir not deleted after topic deletion Key: KAFKA-6093 URL: https://issues.apache.org/jira/browse/KAFKA-6093 Project: Kafka Issue Type: Bug Comp

Re: [DISCUSS] KIP-209 Connection String Support

Just another point to why I’d propose the below change to the string format I propose , is an ability to encode the strings easily. We should note that it’s quite typical for serializers to user a schematic registry where one of their properties they will need to set would be in some form like:

Build failed in Jenkins: kafka-trunk-jdk8 #2152

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- [...truncated 3.30 MB...] kafka.security.auth.SimpleAclAuthorizerTest > testAclIn

Re: [DISCUSS] KIP-209 Connection String Support

Hi Clebert Great kip! Instead of ‘;’ to separate the host sections with the params section could it be a ‘?’ And like wise ‘,’ param separator could this be ‘&’ (keep the ‘,’ for host separator just makes easier to distinguish) Also this was it makes it easier to encode params etc as can just

Re: Doubt about developing a kafka connect with avro

Sounds like you're using Kafka Connect and trying to write a source connector. The Connect framework separates responsibilities: 1. Your source connector is responsible for generating the SourceRecord objects and returning them to the Connect framework via your task's "poll()" method. 2. The Conne

Build failed in Jenkins: kafka-trunk-jdk7 #2907

See -- [...truncated 380.30 KB...] kafka.api.SaslPlainSslEndToEndAuthorizationTest > testNoProduceWithoutDescribeAcl PASSED kafka.api.TransactionsTest > testBasicTransactions STARTED k

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Ah good idea. Hmmm. I can line up the naming and return type but I’m not sure if I can get my hands on the context and the record itself without other changes. Let me dig in and follow up here tomorrow. On Thu, Oct 19, 2017 at 7:14 PM Matthias J. Sax wrote: > Thanks for the KIP. > > Are you fami

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Thanks for the KIP. Are you familiar with KIP-161? https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers I thinks, we should align the design (parameter naming, return types, class names etc) of KIP-210 to KIP-161 to get a unified user experience

Jenkins build is back to normal : kafka-1.0-jdk7 #46

See

Jenkins build is back to normal : kafka-trunk-jdk8 #2151

See

Build failed in Jenkins: kafka-trunk-jdk7 #2906

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- [...truncated 379.33 KB...] kafka.security.auth.SimpleAclAuthorizerTest > testAcl

Re: [VOTE] 1.0.0 RC2

Hi Guozhang, I was able to successfully build the jars on Ubuntu (Java 8 and 9) and Mac (Java 8) and run the quickstart (incl. streams quickstart). On Windows 10, build worked fine with both Java 8 and 9. Quickstarts worked well too, except for streams quickstart, where the following command

Build failed in Jenkins: kafka-trunk-jdk9 #139

See Changes: [me] KAFKA-6087: Scanning plugin.path needs to support relative symlinks. -- Started by an SCM change [EnvInject] - Loading node environment variables. Buildin

Jenkins build is back to normal : kafka-trunk-jdk9 #138

See

Build failed in Jenkins: kafka-1.0-jdk7 #45

See Changes: [jason] MINOR: Update docs with regards to max.in.flight and idempotent producer -- [...truncated 1.81 MB...] org.apache.kafka.streams.TopologyTest > singleSour

[jira] [Resolved] (KAFKA-6087) Scanning plugin.path needs to support relative symlinks

[ https://issues.apache.org/jira/browse/KAFKA-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-6087. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 409

[GitHub] kafka pull request #4092: KAFKA-6087: Scanning plugin.path needs to support ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4092 ---

Build failed in Jenkins: kafka-trunk-jdk7 #2905

See Changes: [jason] MINOR: Update docs with regards to max.in.flight and idempotent producer -- [...truncated 1.39 MB...] org.apache.kafka.common.security.JaasContextTest

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[jira] [Created] (KAFKA-6092) Time passed in punctuate call is currentTime, not punctuate schedule time.

Stephane Maarek created KAFKA-6092: -- Summary: Time passed in punctuate call is currentTime, not punctuate schedule time. Key: KAFKA-6092 URL: https://issues.apache.org/jira/browse/KAFKA-6092 Project

[jira] [Created] (KAFKA-6091) Authorization API is called hundred's of times when there are no privileges

kalyan kumar kalvagadda created KAFKA-6091: -- Summary: Authorization API is called hundred's of times when there are no privileges Key: KAFKA-6091 URL: https://issues.apache.org/jira/browse/KAFKA-6091

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4097: MINOR: Update docs with regards to max.in.flight a...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4097 ---

[GitHub] kafka-site issue #100: MINOR: Pinterest link correction

Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/100 LGTM. Merged to asf-site. ---

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/100 ---

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

@rhauch Here is the previous discussion thread, just reigniting so we can discuss against the original kip thread Cheers Mike Sent from my iPhone > On 5 May 2017, at 02:21, Michael Pearce wrote: > > Hi Ewen, > > Did you get a chance to look at the updated sample showing the idea? > > Did

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Thanks Ted. I filled out that section. --Vahid From: Ted Yu To: dev@kafka.apache.org Date: 10/18/2017 04:59 PM Subject:Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets Please fill out 'Rejected Alternatives' section. Thanks On Wed, Oct 18, 2017

Build failed in Jenkins: kafka-trunk-jdk8 #2150

See Changes: [jason] MINOR: Fix var typo in verifiable_consumer assertion -- [...truncated 1.78 MB...] org.apache.kafka.streams.kstream.internals.KTableAggregateTest > t

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Thanks Thomas for the suggestion. I updated the KIP to explicitly describe that situation. --Vahid From: Thomas Becker To: "dev@kafka.apache.org" Date: 10/19/2017 08:23 AM Subject:Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets I think it would

Re: [DISCUSS] KIP-209 Connection String Support

Do I have to do anything here? I wonder how long I need to wait before proposing the vote. On Tue, Oct 17, 2017 at 1:17 PM, Clebert Suconic wrote: > I had these updates in already... you just changed the names at the > string.. but it was pretty much the same thing I think... I had taken > you s

Jenkins build is back to normal : kafka-trunk-jdk7 #2904

See

Build failed in Jenkins: kafka-trunk-jdk9 #137

See Changes: [jason] MINOR: Fix var typo in verifiable_consumer assertion -- [...truncated 1.41 MB...] kafka.controller.PartitionStateMachineTest > testInvalidNonexistentP

Jenkins build is back to normal : kafka-trunk-jdk8 #2149

See

Jenkins build is back to normal : kafka-1.0-jdk7 #44

See

Build failed in Jenkins: kafka-trunk-jdk7 #2903

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest > shou

[GitHub] kafka-site issue #100: MINOR: Pinterest link correction

Github user manjuapu commented on the issue: https://github.com/apache/kafka-site/pull/100 @guozhangwang I am working on arranging the logos on powered-by page. It is still work in progress in this PR. ---

[GitHub] kafka pull request #4099: MINOR: Use ObjectName.quote instead of URL-encodin...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/4099 MINOR: Use ObjectName.quote instead of URL-encoding for JMX metric tags You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafk

[GitHub] kafka pull request #4098: verifiable_consumer: fix var typo in assert

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4098 ---

Build failed in Jenkins: kafka-1.0-jdk7 #43

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 368.56 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shou

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

Doubt about developing a kafka connect with avro

Hello to everyone, First I would like to give thanks in advantage to everyone willing to help my in this issue. I have been coding a custom kafka connector that read from the twitter api and write in a kafka topic, I have been trying to use avro coding to write those message and i found that it w

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

I think it would be helpful to clarify what happens if consumers rejoin an empty group. I would presume that the expiration timer is stopped and reset back to offsets.retention.minutes when it is empty again but the KIP doesn't say. On Wed, 2017-10-18 at 16:45 -0700, Vahid S Hashemian wrote: H

Re: [kafka-clients] [VOTE] 1.0.0 RC2

just a minor observation: Kafka binary contains two versions of javasist library (javassist-3.20.0-GA.jar, javassist-3.21.0-GA.jar). This dependency is coming from connect project. On Thu, Oct 19, 2017 at 2:16 AM, Guozhang Wang wrote: > Thanks for pointing out, Jun, Ismael. > > Will update the s

Build failed in Jenkins: kafka-trunk-jdk9 #136

See Changes: [damian.guy] KAFKA-6069: Properly tag KafkaStreams metrics with the client id. -- [...truncated 1.02 MB...] org.apache.kafka.clients.producer.MockProducerTest

[jira] [Resolved] (KAFKA-6069) Streams metrics tagged incorrectly

[ https://issues.apache.org/jira/browse/KAFKA-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6069. --- Resolution: Fixed Fix Version/s: 1.0.1 1.1.0 Issue resolved by pull request

[GitHub] kafka pull request #4081: KAFKA-6069: Properly tag KafkaStreams metrics with...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4081 ---

[GitHub] kafka pull request #1542: KAFKA-3892 prune metadata response to subscribed t...

Github user iamnoah closed the pull request at: https://github.com/apache/kafka/pull/1542 ---

[GitHub] kafka pull request #4098: verifiable_consumer: fix var typo in assert

GitHub user edenhill opened a pull request: https://github.com/apache/kafka/pull/4098 verifiable_consumer: fix var typo in assert @hachikuji You can merge this pull request into a Git repository by running: $ git pull https://github.com/edenhill/kafka verfcons_var_fix Alterna

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

@Colin Yes you are right I'll update the KIP-204 mentioning the related ACL permission DELETE on TOPIC @Dong @Ismael Considering future improvements on this, it makes sense to me using a class instead of a Long. Maybe the name could be just "DeleteRecords" (as "NewPartitions") having a dele

[jira] [Created] (KAFKA-6090) Upgrade the Scala recommendation to 2.12

Lionel Cons created KAFKA-6090: -- Summary: Upgrade the Scala recommendation to 2.12 Key: KAFKA-6090 URL: https://issues.apache.org/jira/browse/KAFKA-6090 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk8 #2148

See Changes: [ismael] MINOR: Correct KafkaProducer Javadoc spelling of property -- [...truncated 3.30 MB...] kafka.utils.json.JsonValueTest > testDecodeBoolean STARTED k

Build failed in Jenkins: kafka-trunk-jdk7 #2902

See Changes: [ismael] MINOR: Correct KafkaProducer Javadoc spelling of property -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest > testStateGlobalThr

[jira] [Created] (KAFKA-6089) Transient failure in kafka.network.SocketServerTest.configureNewConnectionException

Rajini Sivaram created KAFKA-6089: - Summary: Transient failure in kafka.network.SocketServerTest.configureNewConnectionException Key: KAFKA-6089 URL: https://issues.apache.org/jira/browse/KAFKA-6089 P

Jenkins build is back to normal : kafka-trunk-jdk9 #135

See

[GitHub] kafka pull request #4097: MINOR: Update docs with regards to max.in.flight a...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4097 MINOR: Update docs with regards to max.in.flight and idempotent producer The idempotent producer doesn't change that setting any more and the accepted range has changed. You can merge this pull re

[GitHub] kafka pull request #4094: MINOR: Correct KafkaProducer Javadoc spelling of p...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4094 ---