Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
Hello Michael, I made a JIRA with sample code to reproduce this problem. I set you as the "shepherd" -- I Hope this is enough, otherwise I can fix it. https://issues.apache.org/jira/browse/SPARK-17092 On Sun, Aug 14, 2016 at 9:38 AM, Michael Armbrust wrote: > Anytime you see JaninoRuntimeExc

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
>>> >>> I can reproduce the problem in SPARK-15285 with master branch. >>> Should we reopen SPARK-15285? >>> >>> Best Regards, >>> Kazuaki Ishizaki, >>> >>> >>> >>> From:Ted Yu >>> To:

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Ted Yu
t;> I can reproduce the problem in SPARK-15285 with master branch. >> Should we reopen SPARK-15285? >> >> Best Regards, >> Kazuaki Ishizaki, >> >> >> >> From:Ted Yu >> To: dhruve ashar >>

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
aster branch. > Should we reopen SPARK-15285? > > Best Regards, > Kazuaki Ishizaki, > > > > From:Ted Yu > To:dhruve ashar > Cc:Aris , "user@spark.apache.org" < > user@spark.apache.org> > Da

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Ted Yu
-15285 with master branch. > Should we reopen SPARK-15285? > > Best Regards, > Kazuaki Ishizaki, > > > > From:Ted Yu > To:dhruve ashar > Cc:Aris , "user@spark.apache.org" > > Date:2016/08/15 06:19 > Subject:

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Kazuaki Ishizaki
: dhruve ashar Cc: Aris , "user@spark.apache.org" Date: 2016/08/15 06:19 Subject: Re: Spark 2.0.0 JaninoRuntimeException Looks like the proposed fix was reverted: Revert "[SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB"

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-14 Thread Ted Yu
Looks like the proposed fix was reverted: Revert "[SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB" This reverts commit fa244e5a90690d6a31be50f2aa203ae1a2e9a1cf. Maybe this was fixed in some other JIRA ? On Fri, Aug 12, 2016 at 2:30 PM, dhruve ashar w

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-14 Thread Michael Armbrust
Anytime you see JaninoRuntimeException you are seeing a bug in our code generation. If you can come up with a small example that causes the problem it would be very helpful if you could open a JIRA. On Fri, Aug 12, 2016 at 2:30 PM, dhruve ashar wrote: > I see a similar issue being resolved rece

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-12 Thread dhruve ashar
I see a similar issue being resolved recently: https://issues.apache.org/jira/browse/SPARK-15285 On Fri, Aug 12, 2016 at 3:33 PM, Aris wrote: > Hello folks, > > I'm on Spark 2.0.0 working with Datasets -- and despite the fact that > smaller data unit tests work on my laptop, when I'm on a cluste

Spark 2.0.0 JaninoRuntimeException

2016-08-12 Thread Aris
Hello folks, I'm on Spark 2.0.0 working with Datasets -- and despite the fact that smaller data unit tests work on my laptop, when I'm on a cluster, I get cryptic error messages: Caused by: org.codehaus.janino.JaninoRuntimeException: Code of method > "(Lorg/apache/spark/sql/catalyst/InternalRow;L