Re: Stream msg using R

2021-07-29 Thread Paulo Ramos
Yes That piece of code is not working for me, because when I run it I am not getting it. I am trying to connect through Data Bricks, so I think I have to change the "local" connection in master? Also, how do I add in the read options the kafka username and psswd? Notes: Kafka is hosted in confl

Re: Stream msg using R

2021-07-29 Thread Blake Miller
I see. Are you able to connect to the databricks spark cluster with a scala repl? The same URL should work with the R spark client. I'm not sure how you're meant to specify the kafka credentials but perhaps this will help you connect r to spark. On Thu, Jul 29, 2021, 6:35 AM Paulo Ramos wrote:

Mirror Maker 2 - High Throughput Identity Mirroring

2021-07-29 Thread Jamie
Hi All,  This blog post: https://blog.cloudera.com/a-look-inside-kafka-mirrormaker-2/ mentions that "High Throughput Identity Mirroring" (when the compression is the same in both the source and destination cluster) will soon be coming to MM2 which would avoid the MM2 consumer decompressing the d

Re: Mirror Maker 2 - High Throughput Identity Mirroring

2021-07-29 Thread Ryanne Dolan
Jamie, this would depend on KIP-712 (or similar) aka "shallow mirroring". This is a work in progress, but I'm optimistic it'll happen at some point. ftr, "IdentityReplicationPolicy" has landed for the upcoming release, tho "identity" in that context just means that topics aren't renamed. Ryanne

Zookeeper SSL error

2021-07-29 Thread john mark
Hi, May I ask for some help about setting up SSL for Zookeeper, please? My goal is just to add SSL for my zookeeper server then just test it using openssl s_client. So far I got this from the logs (WARN) "Empty server certificate chain". So here's what I've done so far. #1 Install Kafka and Zo