Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Jacek Laskowski
en can be apply to. >>> >>> So, in your test case, whole-stage codegen has been already enabled!! >>> >>> FYI. I think that it is a good topic for d...@spark.apache.org. >>> >>> Kazuaki Ishizaki >>> >>> >>> >>> Fro

Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Koert Kuipers
a good topic for d...@spark.apache.org. >> >> Kazuaki Ishizaki >> >> >> >> From: Koert Kuipers >> To:"user@spark.apache.org" >> Date:2017/04/05 05:12 >> Subject:how do i force unit test to do whole stage codegen &

Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Jacek Laskowski
; > FYI. I think that it is a good topic for d...@spark.apache.org. > > Kazuaki Ishizaki > > > > From:Koert Kuipers > To: "user@spark.apache.org" > Date:2017/04/05 05:12 > Subject:how do i force unit test to do whole stage codegen

Re: how do i force unit test to do whole stage codegen

2017-04-04 Thread Koert Kuipers
ly to. > > So, in your test case, whole-stage codegen has been already enabled!! > > FYI. I think that it is a good topic for d...@spark.apache.org. > > Kazuaki Ishizaki > > > > From:Koert Kuipers > To:"user@spark.apache.org" > Date:

Re: how do i force unit test to do whole stage codegen

2017-04-04 Thread Kazuaki Ishizaki
opic for d...@spark.apache.org. Kazuaki Ishizaki From: Koert Kuipers To: "user@spark.apache.org" Date: 2017/04/05 05:12 Subject: how do i force unit test to do whole stage codegen i wrote my own expression with eval and doGenCode, but doGenCode never gets called in test

how do i force unit test to do whole stage codegen

2017-04-04 Thread Koert Kuipers
i wrote my own expression with eval and doGenCode, but doGenCode never gets called in tests. also as a test i ran this in a unit test: spark.range(10).select('id as 'asId).where('id === 4).explain according to https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-sql-whole-stage-codegen.