RE: Date and decimal datatype not working

2015-04-02 Thread BASAK, ANANDA
, p(1), p(2), p(3), p(4), p(5), p(6))) Thanks again. My first code ran successfully giving me some confidence, now I will explore more. Regards Ananda From: BASAK, ANANDA Sent: Thursday, March 26, 2015 4:55 PM To: Dean Wampler Cc: Yin Huai; user@spark.apache.org Subject: RE: Date and decimal dat

RE: Date and decimal datatype not working

2015-03-26 Thread BASAK, ANANDA
To: BASAK, ANANDA Cc: Yin Huai; user@spark.apache.org Subject: Re: Date and decimal datatype not working Recall that the input isn't actually read until to do something that forces evaluation, like call saveAsTextFile. You didn't show the whole stack trace here, but it probably occu

Re: Date and decimal datatype not working

2015-03-25 Thread Dean Wampler
ng.parseLong(Long.java:483) > > at > scala.collection.immutable.StringLike$class.toLong(StringLike.scala:230) > > > > is there something wrong with the TSTAMP field which is Long datatype? > > > > Thanks & Regards > > ----------- > > An

RE: Date and decimal datatype not working

2015-03-25 Thread BASAK, ANANDA
omething wrong with the TSTAMP field which is Long datatype? Thanks & Regards --- Ananda Basak Ph: 425-213-7092 From: Yin Huai [mailto:yh...@databricks.com] Sent: Monday, March 23, 2015 8:55 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not working To store to

Re: Date and decimal datatype not working

2015-03-23 Thread Yin Huai
help me to write a proper syntax to store output in a CSV file? > > > > > > Thanks & Regards > > --- > > Ananda Basak > > Ph: 425-213-7092 > > > > *From:* BASAK, ANANDA > *Sent:* Tuesday, March 17, 2015 3:08 PM > *To:* Yin Hua

RE: Date and decimal datatype not working

2015-03-23 Thread BASAK, ANANDA
bject: RE: Date and decimal datatype not working Ok, thanks for the suggestions. Let me try and will confirm all. Regards Ananda From: Yin Huai [mailto:yh...@databricks.com] Sent: Tuesday, March 17, 2015 3:04 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not wo

RE: Date and decimal datatype not working

2015-03-17 Thread BASAK, ANANDA
Ok, thanks for the suggestions. Let me try and will confirm all. Regards Ananda From: Yin Huai [mailto:yh...@databricks.com] Sent: Tuesday, March 17, 2015 3:04 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not working p(0) is a String. So, you need to

Re: Date and decimal datatype not working

2015-03-17 Thread Yin Huai
p(0) is a String. So, you need to explicitly convert it to a Long. e.g. p(0).trim.toLong. You also need to do it for p(2). For those BigDecimals value, you need to create BigDecimal objects from your String values. On Tue, Mar 17, 2015 at 5:55 PM, BASAK, ANANDA wrote: > Hi All, > > I am very ne