[jira] [Resolved] (KAFKA-3668) Unable to authenticate Kafka broker to secured Zookeeper

2016-05-12 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex resolved KAFKA-3668. - Resolution: Not A Bug > Unable to authenticate Kafka broker to secured Zookeeper > ---

[jira] [Reopened] (KAFKA-3668) Unable to authenticate Kafka broker to secured Zookeeper

2016-05-12 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex reopened KAFKA-3668: - > Unable to authenticate Kafka broker to secured Zookeeper >

[jira] [Updated] (KAFKA-3668) Unable to authenticate Kafka broker to secured Zookeeper

2016-05-12 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex updated KAFKA-3668: Description: Hello, we are running into trouble when trying to connect Kafka broker to secured Zookeeper, Kerberos

[jira] [Resolved] (KAFKA-3668) Unable to authenticate Kafka broker to secured Zookeeper

2016-05-12 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex resolved KAFKA-3668. - Resolution: Not A Bug > Unable to authenticate Kafka broker to secured Zookeeper > ---

[jira] [Closed] (KAFKA-3668) Unable to authenticate Kafka broker to secured Zookeeper

2016-05-12 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex closed KAFKA-3668. --- > Unable to authenticate Kafka broker to secured Zookeeper > > >

[GitHub] kafka pull request: MINOR: Change type of StreamsConfig.BOOTSTRAP_...

2016-05-12 Thread miguno
GitHub user miguno opened a pull request: https://github.com/apache/kafka/pull/1377 MINOR: Change type of StreamsConfig.BOOTSTRAP_SERVERS_CONFIG to List This is an improved version of https://github.com/apache/kafka/pull/1374, where we include a unit test. /cc @ijuma and @g

[GitHub] kafka pull request: MINOR: Change type of StreamsConfig.BOOTSTRAP_...

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1377 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated KAFKA-3686: -- Description: *Setup* I have a cluster of 3 kafka server, a topic with 12 partitions with replica 2, an

[jira] [Updated] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated KAFKA-3686: -- Description: *Setup* I have a cluster of 3 kafka server, a topic with 12 partitions with replica 2, an

[jira] [Resolved] (KAFKA-2868) retry.backoff.ms ignored by Producer

2016-05-12 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-2868. Resolution: Duplicate This was fixed in KAFKA-2138 > retry.backoff.ms ignored by Producer >

Build failed in Jenkins: kafka-0.10.0-jdk7 #83

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Change type of StreamsConfig.BOOTSTRAP_SERVERS_CONFIG to List -- [...truncated 4435 lines...] kafka.admin.AdminRackAwareTest > testAssignmentWith2ReplicasRackAwareW

Build failed in Jenkins: kafka-trunk-jdk8 #619

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Change type of StreamsConfig.BOOTSTRAP_SERVERS_CONFIG to List -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubunt

[jira] [Created] (KAFKA-3707) Introduce a security page on the Kafka website

2016-05-12 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3707: -- Summary: Introduce a security page on the Kafka website Key: KAFKA-3707 URL: https://issues.apache.org/jira/browse/KAFKA-3707 Project: Kafka Issue Type: Improvem

Build failed in Jenkins: kafka-trunk-jdk7 #1284

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Change type of StreamsConfig.BOOTSTRAP_SERVERS_CONFIG to List -- [...truncated 5216 lines...] org.apache.kafka.common.record.RecordTest > testFields[169] PASSED or

[jira] [Commented] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281490#comment-15281490 ] Flavio Junqueira commented on KAFKA-3686: - [~lethalman] thanks for bringing this u

[jira] [Updated] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated KAFKA-3686: -- Description: *Setup* I have a cluster of 3 kafka server, a topic with 12 partitions with replica 2, an

[jira] [Updated] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Bruno updated KAFKA-3686: -- Description: *Setup* I have a cluster of 3 kafka server, a topic with 12 partitions with replica 2, an

[jira] [Commented] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281505#comment-15281505 ] Flavio Junqueira commented on KAFKA-3686: - [~lethalman] Jira is on lockdown becaus

[jira] [Commented] (KAFKA-3686) Kafka producer is not fault tolerant

2016-05-12 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281508#comment-15281508 ] Flavio Junqueira commented on KAFKA-3686: - (on behalf of [~lethalman]) [~fpj] yes

[GitHub] kafka pull request: MINOR: Change type of StreamsConfig.BOOTSTRAP_...

2016-05-12 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/1374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] kafka pull request: MINOR: Remove tag from doap file

2016-05-12 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1378 MINOR: Remove tag from doap file This information from this file is displayed in: https://projects.apache.org/project.html?kafka I removed the tag instead of fixing it because it's o

[jira] [Updated] (KAFKA-3576) Unify KStream and KTable API

2016-05-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3576: - Description: For KTable aggregations, it has a pattern of {{table.groupBy(...).aggregate(...)}},

[jira] [Updated] (KAFKA-3576) Unify KStream and KTable API

2016-05-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3576: - Description: For KTable aggregations, it has a pattern of {{table.groupBy(...).aggregate(...)}},

[GitHub] kafka pull request: MINOR: Call Metrics.close() in KafkaStreams

2016-05-12 Thread jklukas
GitHub user jklukas opened a pull request: https://github.com/apache/kafka/pull/1379 MINOR: Call Metrics.close() in KafkaStreams Initially proposed by @ijuma in https://github.com/apache/kafka/pull/1362#issuecomment-218293662 @mjsax commented: > StreamThread.close(

[jira] [Commented] (KAFKA-3706) kafka-console-consumer.sh picks up old consumer by default

2016-05-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281671#comment-15281671 ] Ismael Juma commented on KAFKA-3706: Thanks for the JIRA and PR. We want to do this ev

[jira] [Commented] (KAFKA-3706) kafka-console-consumer.sh picks up old consumer by default

2016-05-12 Thread Arun Mahadevan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281716#comment-15281716 ] Arun Mahadevan commented on KAFKA-3706: --- [~ijuma] Thanks for the update. I was not a

[jira] [Commented] (KAFKA-3706) kafka-console-consumer.sh picks up old consumer by default

2016-05-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281725#comment-15281725 ] Ismael Juma commented on KAFKA-3706: [~arunmahadevan], sounds good. Perhaps we can clo

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281735#comment-15281735 ] Jiangjie Qin commented on KAFKA-3565: - Thanks for the clarification, Gwen. Just curi

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-12 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281777#comment-15281777 ] Gwen Shapira commented on KAFKA-3565: - Why do I need to override the handler? The has

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281803#comment-15281803 ] Jiangjie Qin commented on KAFKA-3565: - Got it. Yes, if the messages are keyed messages

[jira] [Resolved] (KAFKA-3706) kafka-console-consumer.sh picks up old consumer by default

2016-05-12 Thread Arun Mahadevan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Mahadevan resolved KAFKA-3706. --- Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/KAFKA-3282 > kafka-c

[jira] [Updated] (KAFKA-3707) Introduce a security page on the Kafka website

2016-05-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3707: --- Assignee: Flavio Junqueira > Introduce a security page on the Kafka website >

[GitHub] kafka pull request: MINOR: Fix checkstyle failure in `StreamsConfi...

2016-05-12 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1380 MINOR: Fix checkstyle failure in `StreamsConfigTest` I removed the hamcrest matcher to unbreak the build, but we probably want to tweak the `import-control.xml` as it currently only allows it for ``,

[GitHub] kafka pull request: MINOR: Fix checkstyle failure in `StreamsConfi...

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1380 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-05-12 Thread Harsha
Hi Gwen, Can you look at Parth's last reply. Does it answer your concerns. Thanks, Harsha On Wed, May 4, 2016, at 09:25 AM, parth brahmbhatt wrote: > Thanks for reviewing Gwen. The wiki already has details on token > expiration > under token acquisition process >

[jira] [Assigned] (KAFKA-3705) Support non-key joining in KTable

2016-05-12 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liquan Pei reassigned KAFKA-3705: - Assignee: Liquan Pei (was: Guozhang Wang) > Support non-key joining in KTable >

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Tom Crayford
We've started running our usual suite of performance tests against Kafka 0.10.0.0 RC. These tests orchestrate multiple consumer/producer machines to run a fairly normal mixed workload of producers and consumers (each producer/consumer are just instances of kafka's inbuilt consumer/producer perf tes

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Gwen Shapira
Just to confirm: You tested both versions with plain text and saw no performance drop? On Thu, May 12, 2016 at 1:26 PM, Tom Crayford wrote: > We've started running our usual suite of performance tests against Kafka > 0.10.0.0 RC. These tests orchestrate multiple consumer/producer machines to > r

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Tom Crayford
Yep, confirm. On Thu, May 12, 2016 at 9:37 PM, Gwen Shapira wrote: > Just to confirm: > You tested both versions with plain text and saw no performance drop? > > > On Thu, May 12, 2016 at 1:26 PM, Tom Crayford > wrote: > > We've started running our usual suite of performance tests against Kafka

Build failed in Jenkins: kafka-0.10.0-jdk7 #84

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix checkstyle failure in `StreamsConfigTest` -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-5 (docker Ubun

Jenkins build is back to normal : kafka-trunk-jdk7 #1285

2016-05-12 Thread Apache Jenkins Server
See

[GitHub] kafka pull request: MINOR: Remove tag from doap file

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #620

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix checkstyle failure in `StreamsConfigTest` -- [...truncated 4449 lines...] kafka.admin.AdminRackAwareTest > testAssignmentWith2ReplicasRackAwareWith6Partitions P

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Gwen Shapira
I know it is a big ask, but can you try bisecting? For example, test before/after on commits: * 45c8195 KAFKA-3025; Added timetamp to Message and use relative offset. * 5b375d7 KAFKA-3149; Extend SASL implementation to support more mechanisms * 69d9a66 KAFKA-3618; Handle ApiVersionsRequest before

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Ismael Juma
Hi Tom, This is puzzling because, as you said, not much has changed in the TLS code since 0.9.0.1. A JIRA sounds good. I was going to ask if you could test the commit before/after KAFKA-3025, but I see that Gwen has already done that. :) Ismael On Thu, May 12, 2016 at 9:26 PM, Tom Crayford wrot

Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Mayuresh Gharat
HI I am trying to establish an SSL connection from kafkaProducer and send certificate to the Kafka Broker. I deploy my kafka broker locally running 2 ports : *listeners = PLAINTEXT://:9092,SSL://:16637 * *My KafkaBroker SSL configs look like this :* ssl.protocol = TLS ssl.trustmanager.algorithm

Bug in KafkaLog4jAppender Kerberos support

2016-05-12 Thread Gibson, Todd
I apologize if this is the wrong place to report bugs... And I'm not sure this is really a bug, just an improvement that would make my life easier. The code below was added to the KafkaLog4jAppender in version 10.0.0 to support Kerberos. I think the null check for clientJaasConfPath should be

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Ismael Juma
Hi Mayuresh, You need to enable client authentication by setting `ssl.client.auth` to `required` or `requested` (I suggest the former). Ismael On Thu, May 12, 2016 at 10:35 PM, Mayuresh Gharat < gharatmayures...@gmail.com> wrote: > HI I am trying to establish an SSL connection from kafkaProduce

Re: Bug in KafkaLog4jAppender Kerberos support

2016-05-12 Thread Gwen Shapira
In general, https://issues.apache.org/jira/browse/KAFKA would be a good place to report such issues. You can also submit a solution through a github pull request: https://github.com/apache/kafka As far as I can see, you are correct and there is no reason to require a configuration if you can also

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Jun Rao
Tom, Thanks for reporting this. A few quick comments. 1. Did you send the right command for producer-perf? The command limits the throughput to 100 msgs/sec. So, not sure how a single producer can get 75K msgs/sec. 2. Could you collect some stats (e.g. average batch size) in the producer and see

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Tom Crayford
Yep, I can try those particular commits tomorrow. Before I try a bisect, I'm going to replicate with a less intensive to iterate on smaller scale perf test. Jun, inline: On Thursday, 12 May 2016, Jun Rao wrote: > Tom, > > Thanks for reporting this. A few quick comments. > > 1. Did you send the

Build failed in Jenkins: kafka-trunk-jdk8 #621

2016-05-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Remove tag from doap file -- [...truncated 5611 lines...] org.apache.kafka.streams.processor.internals.assignment.SubscriptionInfoTest > testEncodeDecode PASSED o

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Mayuresh Gharat
Thanks a lot Ismael :) Was able to get pass it. Now trying to figure out from broker logs : INFO [KafkaApis] [kafka-request-handler-0] [kafka-server] [] [KafkaApi-0] Auto creation of topic testToic_1 with 8 partitions and replication factor 1 is successful! [KafkaApis] [kafka-request-handler-

Re: [VOTE] 0.10.0.0 RC4

2016-05-12 Thread Jun Rao
Tom, We don't have a CSV metrics reporter in the producer right now. The metrics will be available in jmx. You can find out the details in http://kafka.apache.org/documentation.html#new_producer_monitoring Thanks, Jun On Thu, May 12, 2016 at 3:08 PM, Tom Crayford wrote: > Yep, I can try those

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Ismael Juma
Are you using any of the advertised.* configs by any chance? If so, you have to use advertised.listeners only, the other ones will only advertise a PLAINTEXT listener. Ismael On Fri, May 13, 2016 at 12:24 AM, Mayuresh Gharat < gharatmayures...@gmail.com> wrote: > Thanks a lot Ismael :) > > Was

[Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Greg Fodor
We noticed that some errors were happening in one of our KafkaStreams jobs but they were not appearing in our logs or being sent to our error reporting service (Airbrake) -- they only became visible on stdout when running from the console. I believe the reason is because of this explicit catch-reth

Re: [Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Guozhang Wang
Greg, Could you post the output from stdout when running the console as well? Guozhang On Thu, May 12, 2016 at 4:52 PM, Greg Fodor wrote: > We noticed that some errors were happening in one of our KafkaStreams > jobs but they were not appearing in our logs or being sent to our > error reporti

[jira] [Commented] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-05-12 Thread TAO XIAO (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282271#comment-15282271 ] TAO XIAO commented on KAFKA-3163: - Hi, Do we have this KIP in the upcoming 0.10.0.0 relea

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Mayuresh Gharat
All of them are set to "". BTW, I printed out the BrokerEndoints on the broker in KafkaApis.handleTopicMetadataRequest() and surprisingly it prints : WARN [KafkaApis] [kafka-request-handler-9] [kafka-server] [] [KafkaApi-0] ENDPOINTS: Stream(Map(PLAINTEXT -> EndPoint(hostname,9092,PLAINTEXT)), ?)

[jira] [Commented] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-05-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282288#comment-15282288 ] Jiangjie Qin commented on KAFKA-3163: - [~xiaotao183] No, this KIP will not be in 0.10.

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Ismael Juma
`Stream` is a lazy collection and only the first element is printed (that's why you see the `?` in the output). What version of Kafka are you using? I know I changed the code in that method not to use `Stream` at some point during the 0.10 development cycle. Ismael On Fri, May 13, 2016 at 1:35 AM

Re: [Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Greg Fodor
Hey Guozhang, output was silent (since the log4j is streaming it to a log file) except for the stack trace landing in stdout, i'm assuming from the rethrow: Exception in thread "StreamThread-9" org.apache.kafka.common.errors.SerializationException: Error serializing Avro message Caused by: java.l

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Mayuresh Gharat
Its pre 0.9 release i think. I have trunk and some cherry picks, so can't tell you the exact released version as such. But if I set those advertised.*="" then those should not be causing *"kafka.common.**BrokerEndPointNotAvailableExce* *ption: End point SSL not found for broker 0".* Thanks, Mayu

[jira] [Commented] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-05-12 Thread TAO XIAO (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282310#comment-15282310 ] TAO XIAO commented on KAFKA-3163: - [~becket_qin] Thanks. Does the KIP doc in wiki reflect

[GitHub] kafka pull request: KAFKA-3421: Connect developer guide update and...

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1366 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: Peer not authenticated when trying to send message to kafka over SSL with Authentication

2016-05-12 Thread Mayuresh Gharat
I think I was specifying the wrong interBrokerProtocolVersion. Thanks, Mayuresh On Thu, May 12, 2016 at 6:05 PM, Mayuresh Gharat wrote: > Its pre 0.9 release i think. > I have trunk and some cherry picks, so can't tell you the exact released > version as such. > But if I set those advertise

[GitHub] kafka pull request: KAFKA-3520: Add system tests for REST APIs of ...

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1195 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3520) System tests of config validate and list connectors REST APIs

2016-05-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3520: - Resolution: Fixed Fix Version/s: 0.10.0.0 Status: Resolved (was:

Build failed in Jenkins: kafka-0.10.0-jdk7 #85

2016-05-12 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3421: Connect developer guide update and several fixes [me] KAFKA-3520: Add system tests for REST APIs of list connector plugins and -- Started by an SCM change [EnvInjec

Re: [Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Guozhang Wang
After looking at the source code (trunk), I think this is a bug that there are some cases where KafkaExceptions are not logged in log4j yet before it pop up to the StreamThread. I will file a JIRA for this issue. Guozhang On Thu, May 12, 2016 at 5:57 PM, Greg Fodor wrote: > Hey Guozhang, outpu

Build failed in Jenkins: kafka-trunk-jdk8 #622

2016-05-12 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3421: Connect developer guide update and several fixes [me] KAFKA-3520: Add system tests for REST APIs of list connector plugins -- Started by an SCM change [EnvInject] -

[jira] [Commented] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-05-12 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282348#comment-15282348 ] Jiangjie Qin commented on KAFKA-3163: - [~xiaotao183] The KIP doc listed two different

[GitHub] kafka pull request: MINOR: Fix bugs in KafkaStreams.close()

2016-05-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3708) Rethink exception handling in KafkaStreams

2016-05-12 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3708: Summary: Rethink exception handling in KafkaStreams Key: KAFKA-3708 URL: https://issues.apache.org/jira/browse/KAFKA-3708 Project: Kafka Issue Type: Bug

Re: [Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Guozhang Wang
Filed https://issues.apache.org/jira/browse/KAFKA-3708 As for your case now, you can see if setting KafkaStreams. setUncaughtExceptionHandler works for you or not. In the future, it maybe better handling them in the library and stop the process since they are not really recoverable. Guozhang On

Re: [Streams] Reason for swallowing KafkaExceptions?

2016-05-12 Thread Greg Fodor
great, thanks! On Thu, May 12, 2016 at 9:57 PM, Guozhang Wang wrote: > Filed https://issues.apache.org/jira/browse/KAFKA-3708 > > As for your case now, you can see if setting KafkaStreams. > setUncaughtExceptionHandler works for you or not. > In the future, it maybe better handling them in the li

Build failed in Jenkins: kafka-trunk-jdk7 #1288

2016-05-12 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix bugs in KafkaStreams.close() -- [...truncated 4472 lines...] kafka.admin.AdminRackAwareTest > testAssignmentWithRackAware PASSED kafka.admin.AdminRackAwareTe