Re: Accessing Secure Hadoop from Mesos cluster

2016-04-14 Thread Michael Gummelt
DCOS Spark 1.6.1 supports kerberos. It'll be available in DCOS 1.7, to be released in a couple weeks. On Tue, Apr 12, 2016 at 9:57 PM, Tony Kinsley wrote: > I have been working towards getting some spark streaming jobs to run in > Mesos cluster mode (using docker containers) and write data peri

Accessing Secure Hadoop from Mesos cluster

2016-04-12 Thread Tony Kinsley
I have been working towards getting some spark streaming jobs to run in Mesos cluster mode (using docker containers) and write data periodically to a secure HDFS cluster. Unfortunately this does not seem to be well supported currently in spark ( https://issues.apache.org/jira/browse/SPARK-12909). T