On Wed, 2012-04-11 at 01:14 +0200, Eric Botcazou wrote: > > I can't derive a definition of "token" from your example that seems > > meaningful. It can't be parser tokens I assume, because you split > > GET_FIELD_DECL (but why in 2 not 3?). > > FIELD_DECL is a single object, see tree.def.
So, you only know it's 2 tokens once you know all of tree.def? I'm aware that this is just some arbitrary example, but I believe this actually strengthens the concern I had.
