Thanks JIm
You suggestion is very useful to me.
Here is my another concern to the method you provided:
If the file is very large, would it lead the lexer to read though the
whole file? If it is, I think it would be slower than the method of
just telling the lexer to stop.
On 1/16/09, Jim Idle <j...@temporal-wave.com> wrote:
> chain one wrote:
>>
>> I want to only parse the beginning of a file. And I don't want the
>> recognizer to beak the whole file into huge number of tokens which will
>> make the memory consuming very high.
>> So after the lexer having recognized one specified TOKEN such as ";", I
>> want to tell the lexer to stop, and pass the tokens to the parser.
>> Is it possible in C runtime target? If it is, could you tell me how?
>>
>>
>> SEMI: ';' { // throw the EOF token?}
>> ;
>>
> If the trigger point is as simple as this, then why not just:
>
> SEMI : ';' .* ;
>
> Remember that the text is not copied into the token, it is just a pointer to
> the start and end of the text and so does not take up any memory.
>
> Jim
>>
>>
>> Thanks
>>
>> ________________________________
>>
>> List: http://www.antlr.org/mailman/listinfo/antlr-interest
>> Unsubscribe:
>> http://www.antlr.org/mailman/options/antlr-interest/your-email-address
>>
>
>
>
--
Sent from my mobile device
List: http://www.antlr.org/mailman/listinfo/antlr-interest
Unsubscribe:
http://www.antlr.org/mailman/options/antlr-interest/your-email-address
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"il-antlr-interest" group.
To post to this group, send email to il-antlr-interest@googlegroups.com
To unsubscribe from this group, send email to
il-antlr-interest+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/il-antlr-interest?hl=en
-~----------~----~----~----~------~----~------~--~---
