Re: some joins stopped working with spark 2.0.0 SNAPSHOT

2016-02-27 Thread Jonathan Kelly
If you want to find what commit caused it, try out the "git bisect" command. On Sat, Feb 27, 2016 at 11:06 AM Koert Kuipers wrote: > https://issues.apache.org/jira/browse/SPARK-13531 > > On Sat, Feb 27, 2016 at 3:49 AM, Reynold Xin wrote: > >> Can you file a JIRA ticket? >> >> >> On Friday, Febr

Re: some joins stopped working with spark 2.0.0 SNAPSHOT

2016-02-27 Thread Koert Kuipers
https://issues.apache.org/jira/browse/SPARK-13531 On Sat, Feb 27, 2016 at 3:49 AM, Reynold Xin wrote: > Can you file a JIRA ticket? > > > On Friday, February 26, 2016, Koert Kuipers wrote: > >> dataframe df1: >> schema: >> StructType(StructField(x,IntegerType,true)) >> explain: >> == Physical P

Re: some joins stopped working with spark 2.0.0 SNAPSHOT

2016-02-27 Thread Reynold Xin
Can you file a JIRA ticket? On Friday, February 26, 2016, Koert Kuipers wrote: > dataframe df1: > schema: > StructType(StructField(x,IntegerType,true)) > explain: > == Physical Plan == > MapPartitions , obj#135: object, [if (input[0, > object].isNullAt) null else input[0, object].get AS x#128] >

some joins stopped working with spark 2.0.0 SNAPSHOT

2016-02-26 Thread Koert Kuipers
dataframe df1: schema: StructType(StructField(x,IntegerType,true)) explain: == Physical Plan == MapPartitions , obj#135: object, [if (input[0, object].isNullAt) null else input[0, object].get AS x#128] +- MapPartitions , createexternalrow(if (isnull(x#9)) null else x#9), [input[0, object] AS obj#13