Just to confirm, is this what you are mentioning about? Is there any example on how to set it? I believe it is for 0.8.3 version?
https://cwiki.apache.org/confluence/display/KAFKA/Multiple+Listeners+for+Kafka+Brokers On Fri, Aug 28, 2015 at 12:52 PM, Sriharsha Chintalapani <ka...@harsha.io> wrote: > You can configure PLAINTEXT listener as well with the broker and use that > port for spark. > > -- > Harsha > > > On August 28, 2015 at 12:24:45 PM, Sourabh Chandak (sourabh3...@gmail.com) > wrote: > > Can we use the existing kafka spark streaming jar to connect to a kafka > server running in SSL mode? > > We are fine with non SSL consumer as our kafka cluster and spark cluster > are in the same network > > > Thanks, > Sourabh > > On Fri, Aug 28, 2015 at 12:03 PM, Gwen Shapira <g...@confluent.io> wrote: > I can't speak for the Spark Community, but checking their code, > DirectKafkaStream and KafkaRDD use the SimpleConsumer API: > > > https://github.com/apache/spark/blob/master/external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DirectKafkaInputDStream.scala > > https://github.com/apache/spark/blob/master/external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaRDD.scala > > On Fri, Aug 28, 2015 at 11:32 AM, Cassa L <lcas...@gmail.com> wrote: > > > Hi I am using below Spark jars with Direct Stream API. > > spark-streaming-kafka_2.10 > > > > When I look at its pom.xml, Kafka libraries that its pulling in is > > <groupId>org.apache.kafka</groupId> > > <artifactId>kafka_${scala.binary.version}</artifactId> > > <version>0.8.2.1</version> > > > > > > I believe this DirectStream API uses SimpleConsumer API. Can someone from > > Spark community confirm too? > > > > Thanks, > > LCassa. > > > > On Fri, Aug 28, 2015 at 11:12 AM, Sriharsha Chintalapani < > ka...@harsha.io> > > wrote: > > > > > SSL is supported for new producer and consumer api and old api (simple > > > consumer and high-level consumer) is not supported. > > > I think spark uses simple consumer? if so its not supported. > > > > > > Thanks, > > > Harsha > > > > > > > > > On August 28, 2015 at 11:00:30 AM, Cassa L (lcas...@gmail.com) wrote: > > > > > > Hi, > > > I was going through SSL setup of Kafka. > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Deploying+SSL+for+Kafka > > > However, I am also using Spark-Kafka streaming to read data from Kafka. > > Is > > > there a way to activate SSL for spark streaming API or not possible at > > > all? > > > > > > Thanks, > > > LCassa > > > > > > > > > >
