Spark Executor - jaas.conf with useTicketCache=true

Hi All, Apologies for cross posting, I posted this on Kafka user group. Is there any way that I can use kerberos ticket cache of the spark executor for reading from secured kafka? I am not 100% that the executor would do a kinit, but I presume so to be able to run code / read hdfs etc as the user

Re: Why do checkpoints work the way they do?

commend you to try out Structured >>> Streaming instead of DStreams (which is effectively in maintenance mode). >>> >>> >>> On Fri, Aug 25, 2017 at 7:41 PM, Hugo Reinwald >>> wrote: >>> >>>> Hello, >>>> >>&g

Why do checkpoints work the way they do?

Hello, I am implementing a spark streaming solution with Kafka and read that checkpoints cannot be used across application code changes - here I tested changes in application code and got the error message as b below -