Re: spark driver in docker

I am trying to do the same but till now no luck... I have everything running inside docker container including mesos master, mesos slave , marathon , spark mesos cluster dispatcher. But when I try to submit the job using spark submit as a docker container it fails ... Between this setup is on s

Re: DataFrame Find/Filter Based on Input - Inside Map function

I need to pass the value of the filter dynamically like where id= and that someVal exist in another RDD. How can I do this across JavaRDD and DataFrame ? Sent from my iPad > On Jul 2, 2015, at 12:49 AM, ayan guha wrote: > > You can directly use filter on a Dataframe > >> On 2 Jul 2015 12:15,