>>>>> "Vivek" == vivhari <vivh...@gmail.com> writes:
Vivek> If any of you would be able to help me locate the tokenization Vivek> part of GCC and the input / output format for tokenizer part of Vivek> GCC, it would be very useful to us. Tokenization is handled by the preprocessor, see the libcpp directory. The input is just files. There isn't really any "output format", it just returns tokens to the caller. But perhaps I misunderstand what you are asking for here. Tom