Kafka SASL (Kerberos) - UNKNOWN_TOPIC_OR_PARTITION

Hello, Having trouble when publishing and consuming from a topic with SASL_PLAINTEXT. Both ZK and Kafka start successfully, in logs I see SASL_PLAINTEXT on 9093 as being available. kafka.log:[2018-08-20 03:31:08,202] INFO Registered broker 1 at path /brokers/ids/1 with addresses: EndPoint(kafkab

[ANNOUNCE] New Kafka PMC member: Dong Lin

Hi everyone, Dong Lin became a committer in March 2018. Since then, he has remained active in the community and contributed a number of patches, reviewed several pull requests and participated in numerous KIP discussions. I am happy to announce that Dong is now a member of the Apache Kafka PMC. C

Re: Kafka SASL (Kerberos) - UNKNOWN_TOPIC_OR_PARTITION

is auto topic creation enabled on server? Any deny logs in kafka-authorizer.log? What is the inter-broker protocol configured? If it is SSL, SSL user should have ClusterAction permission. On Mon, Aug 20, 2018 at 3:33 PM Matt L wrote: > Hello, > > Having trouble when publishing and consuming from

Re: NetworkException exception while send/publishing records(Producer)

Thanks Shantanu for your response. The size is the business req. which might also increase later and I am using max.request .size as 1Gb I will try the compression of the data and see the performance. and sharing the producer blocks the other threads as the data is big and also it leads to resourc

Missing Public Key

The code signing key for Kafka version 1.1.1 [0] does not have a corresponding public key in the project’s KEYS [1] file. Therefore GPG verification produces the following error: Is anyone able to update the KEYS file? [0] https://www.apache.org/dist/kafka/1.1.1/kafka_2.11-1.1.1.tgz.asc [1]

Re: Kafka SASL (Kerberos) - UNKNOWN_TOPIC_OR_PARTITION

Thanks for the pointer Manikumar! It looks like it was my interbroker communication, this was set to SSL so inter broker users were coming in as ANONYMOUS. Once i changed this to SASL_SSL I was able to publish/consume. One remaining question i have is around allow.everyone.if.no.acl.found=true. D

Issue in Kafka 2.0.0 ?

Hi, I’m using the org.kafka.streams.scala that was released with version 2.0.0. I’m getting a StackOverflowError as follows: java.lang.StackOverflowError at org.apache.kafka.streams.scala.kstream.KTable.filter(KTable.scala:49) at org.apache.kafka.streams.scala.kstream.KTable.filter(KTable.scala:

Re: Issue in Kafka 2.0.0 ?

I think what happened in your use case was that the following implicit from ImplicitConversions.scala kept wrapping the resultant KTable from filter(): implicit def wrapKTable[K, V](inner: KTableJ[K, V]): KTable[K, V] = leading to stack overflow. Cheers On Mon, Aug 20, 2018 at 12:50 PM Druhin

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong Lin! Well deserved! On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerou

Re: Issue in Kafka 2.0.0 ?

Isn’t that a bug then? Or can I fix my code somehow? On August 20, 2018 at 1:30:42 PM, Ted Yu (yuzhih...@gmail.com) wrote: I think what happened in your use case was that the following implicit from ImplicitConversions.scala kept wrapping the resultant KTable from f

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong !!! Thanks, Mayuresh On Mon, Aug 20, 2018 at 1:36 PM Gwen Shapira wrote: > Congrats Dong Lin! Well deserved! > > On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the c

Re: Issue in Kafka 2.0.0 ?

I was able to reproduce what you saw with modification to StreamToTableJoinScalaIntegrationTestImplicitSerdes.scala I have logged KAFKA-7316 and am looking for a fix. FYI On Mon, Aug 20, 2018 at 1:39 PM Druhin Sagar Goel wrote: > Isn’t that a bug then? Or can I fix my code somehow? > > > > On A

Re: Issue in Kafka 2.0.0 ?

Thanks for reporting and for creating the ticket! -Matthias On 8/20/18 5:17 PM, Ted Yu wrote: > I was able to reproduce what you saw with modification > to StreamToTableJoinScalaIntegrationTestImplicitSerdes.scala > I have logged KAFKA-7316 and am looking for a fix. > > FYI > > On Mon, Aug 20,

Re: Issue in Kafka 2.0.0 ?

Is this related to the fix https://github.com/apache/kafka/pull/5502 that is currently being worked on? Guozhang On Mon, Aug 20, 2018 at 5:19 PM, Matthias J. Sax wrote: > Thanks for reporting and for creating the ticket! > > -Matthias > > On 8/20/18 5:17 PM, Ted Yu wrote: > > I was able to rep

Re: Issue in Kafka 2.0.0 ?

Thanks a lot Ted! FYI - The issue is not limited to the org.apache.kafka.streams.scala.KTable.filter. It also happens with org.apache.kafka.streams.scala.KTable.filterNot, org.apache.kafka.streams.scala.KStream.foreach and org.apache.kafka.streams.scala.KStream.peek. - Druhin On August 20,

Re: Issue in Kafka 2.0.0 ?

Thanks for pointing me to that PR. I applied the PR locally but still got: org.apache.kafka.streams.scala.StreamToTableJoinScalaIntegrationTestImplicitSerdes > testShouldCountClicksPerRegion FAILED java.lang.StackOverflowError I can go over that PR to see what can be referenced for solving t

Re: Issue in Kafka 2.0.0 ?

Hi, I am aware that more than one method from KTable.scala have this issue. Once I find a solution, I will apply the fix to the methods you listed. Cheers On Mon, Aug 20, 2018 at 5:23 PM Druhin Sagar Goel wrote: > Thanks a lot Ted! > > FYI - The issue is not limited to the > org.apache.kafka.s

Re: Issue in Kafka 2.0.0 ?

Sent out a PR #5543 which fixes the reported bug, with StreamToTableJoinScalaIntegrationTestImplicitSerdes.testShouldCountClicksPerRegion modified adding the filter methods. FYI On Mon, Aug 20, 2018 at 5:26 PM Ted Yu wrote: > Thanks for pointing me to that PR. > > I applied the PR locally but

Re: Kafka SASL (Kerberos) - UNKNOWN_TOPIC_OR_PARTITION

"allow.everyone.if.no.acl.found" config is applicable for Kafka's inbuilt authorizer implementation (SimpleAclAuthorizer). What is the Kafka version? You can check authorizer debug logs starting with "No acl found for resource..." make sure no acls for ANONYMOUS user. Are you using any custom aut