Re: how to make a spark cluster ?

2015-04-21 Thread haihar nahak
doop. > > > On Mon, Apr 20, 2015 at 3:21 PM, haihar nahak > wrote: > >> Thank you :) >> >> On Mon, Apr 20, 2015 at 4:46 PM, Jörn Franke >> wrote: >> >>> Hi, If you have just one physical machine then I would try out Docker >>> instead of

Re: how to make a spark cluster ?

2015-04-20 Thread haihar nahak
Thank you :) On Mon, Apr 20, 2015 at 4:46 PM, Jörn Franke wrote: > Hi, If you have just one physical machine then I would try out Docker > instead of a full VM (would be waste of memory and CPU). > > Best regards > Le 20 avr. 2015 00:11, "hnahak" a écrit : > >> Hi All, >> >> I've big physical m

Re: How to send user variables from Spark client to custom InputFormat or RecordReader ?

2015-02-22 Thread haihar nahak
Thanks. I extract hadoop configuration and set a my arbitrary variable and able to get inside InputFormat from JobContext.configuration On Mon, Feb 23, 2015 at 12:04 PM, Tom Vacek wrote: > The SparkConf doesn't allow you to set arbitrary variables. You can use > SparkContext's HadoopRDD and cre

Re: Posting to the list

2015-02-22 Thread haihar nahak
I checked it but I didn't see any mail from user list. Let me do it one more time. [image: Inline image 1] --Harihar On Mon, Feb 23, 2015 at 11:50 AM, Ted Yu wrote: > bq. i didnt get any new subscription mail in my inbox. > > Have you checked your Spam folder ? > > Cheers > > On Sun, Feb 22, 2