Re: Whole-stage codegen and SparkPlan.newPredicate

2018-01-16 Thread Jacek Laskowski
To:Kazuaki Ishizaki > Cc:Jacek Laskowski , dev > Date: 2018/01/02 04:12 > > Subject:Re: Whole-stage codegen and SparkPlan.newPredicate > -- > > > > Wrong ticket: *https://issues.apache.org/j

Re: Whole-stage codegen and SparkPlan.newPredicate

2018-01-01 Thread Kazuaki Ishizaki
updated the JIRA ticket. I am still working for this. Kazuaki Ishizaki From: Herman van Hövell tot Westerflier To: Kazuaki Ishizaki Cc: Jacek Laskowski , dev Date: 2018/01/02 04:12 Subject:Re: Whole-stage codegen and SparkPlan.newPredicate Wrong ticket: https

Re: Whole-stage codegen and SparkPlan.newPredicate

2018-01-01 Thread Herman van Hövell tot Westerflier
> > Best Regards, > Kazuaki Ishizaki > > > > From:Herman van Hövell tot Westerflier > To:Jacek Laskowski > Cc:dev > Date: 2017/12/31 21:44 > Subject:Re: Whole-stage codegen and SparkPlan.newPredicate > ---

Re: Whole-stage codegen and SparkPlan.newPredicate

2018-01-01 Thread Kazuaki Ishizaki
produces incorrect results. I created a JIRA entry https://issues.apache.org/jira/browse/SPARK-22934. Best Regards, Kazuaki Ishizaki From: Herman van Hövell tot Westerflier To: Jacek Laskowski Cc: dev Date: 2017/12/31 21:44 Subject:Re: Whole-stage codegen and

Re: Whole-stage codegen and SparkPlan.newPredicate

2017-12-31 Thread Herman van Hövell tot Westerflier
Hi Jacek, In this case whole stage code generation is turned off. However we still use code generation for a lot of other things: projections, predicates, orderings & encoders. You are currently seeing a compile time failure while generating a predicate. There is currently no easy way to turn code