Re: pyspark 1.4 udf change date values

2015-07-17 Thread Luis Guerra
Sure, I have created JIRA SPARK-9131 - UDF change data values On Thu, Jul 16, 2015 at 7:09 PM, Davies Liu wrote: > Thanks for reporting this, could you file a JIRA for it? > > On Thu, Jul 16, 2015 at 8:22 AM, Luis Guerra > wrote: > > Hi all, >

Re: pyspark 1.4 udf change date values

2015-07-16 Thread Davies Liu
Thanks for reporting this, could you file a JIRA for it? On Thu, Jul 16, 2015 at 8:22 AM, Luis Guerra wrote: > Hi all, > > I am having some troubles when using a custom udf in dataframes with pyspark > 1.4. > > I have rewritten the udf to simplify the problem and it gets even weirder. > The udfs

pyspark 1.4 udf change date values

2015-07-16 Thread Luis Guerra
Hi all, I am having some troubles when using a custom udf in dataframes with pyspark 1.4. I have rewritten the udf to simplify the problem and it gets even weirder. The udfs I am using do absolutely nothing, they just receive some value and output the same value with the same format. I show you