Hi, I have only encountered 'code too large' errors when changing grammars. I am using SBT/Idea, no Eclipse.
The size of an ANTLR Parser/Lexer is dependent on the rules inside the source grammar and the rules it depends on. So we should take a look at the IdentifiersParser.g/ExpressionParser.g; the problem is probably caused by the nonReserved rule. HTH Kind regards, Herman van Hövell 2016-01-28 16:43 GMT+01:00 Ted Yu <yuzhih...@gmail.com>: > After this change: > [SPARK-12681] [SQL] split IdentifiersParser.g into two files > > the biggest file under > sql/catalyst/src/main/antlr3/org/apache/spark/sql/catalyst/parser is > SparkSqlParser.g > > Maybe split SparkSqlParser.g up as well ? > > On Thu, Jan 28, 2016 at 5:21 AM, Iulian Dragoș <iulian.dra...@typesafe.com > > wrote: > >> Hi, >> >> Has anyone seen this error? >> >> The code of method specialStateTransition(int, IntStream) is exceeding the >> 65535 bytes limit SparkSqlParser_IdentifiersParser.java:39907 >> >> The error is in ANTLR generated files and it’s (according to Stack >> Overflow) due to state explosion in parser (or lexer). That seems >> plausible, given that one file has >50000 lines of code. Some suggest that >> refactoring the grammar would help. >> >> I’m seeing this error only sometimes on the command line (building with >> Sbt), but every time when building with Eclipse (which has its own Java >> compiler, so it’s not surprising that it has a different behavior). Same >> behavior with both Java 1.7 and 1.8. >> >> Any ideas? >> >> iulian >> >> -- >> >> -- >> Iulian Dragos >> >> ------ >> Reactive Apps on the JVM >> www.typesafe.com >> >> >
