Re: Not getting it

2014-03-28 Thread lannyripple
he partitioning ? >> >> Best Regards, >> Sonal >> Nube Technologies <http://www.nubetech.co> >> >> <http://in.linkedin.com/in/sonalgoyal> >> >> >> >> >> On Thu, Mar 27, 2014 at 10:04 AM, lannyripple <[hidden >> ema

Re: Not getting it

2014-03-28 Thread lannyripple
amp;i=0> > > wrote: > >> Hi all, >> >> I've got something which I think should be straightforward but it's not so >> I'm not getting it. >> >> I have an 8 node spark 0.9.0 cluster also running HDFS. Workers have 16g >> of >&g

Re: Not getting it

2014-03-28 Thread Sonal Goyal
ward but it's not so > I'm not getting it. > > I have an 8 node spark 0.9.0 cluster also running HDFS. Workers have 16g > of > memory using 8 cores. > > In HDFS I have a CSV file of 110M lines of 9 columns (e.g., > [key,a,b,c...]). > I have another file of 25K

Not getting it

2014-03-26 Thread lannyripple
Hi all, I've got something which I think should be straightforward but it's not so I'm not getting it. I have an 8 node spark 0.9.0 cluster also running HDFS. Workers have 16g of memory using 8 cores. In HDFS I have a CSV file of 110M lines of 9 columns (e.g., [key,a,b,c...]).