Re: TeX's parser.

2001-08-21 Thread Jules Bean
On Tue, Aug 21, 2001 at 10:29:04AM -0700, Mike Ressler wrote: > On Tue, 21 Aug 2001, Andre Poenitz wrote: > > I wonder at what time TeX's input routeine transforms "incoming chars" into > > tokens. This obviously is not something like a preprocessing phase, since > > this would not allow for catco

Re: TeX's parser.

2001-08-21 Thread Mike Ressler
On Tue, 21 Aug 2001, Andre Poenitz wrote: > I wonder at what time TeX's input routeine transforms "incoming chars" into > tokens. This obviously is not something like a preprocessing phase, since > this would not allow for catcode changes. I don't remember the answer off the top of my head, but I

TeX's parser.

2001-08-20 Thread Andre Poenitz
I wonder at what time TeX's input routeine transforms "incoming chars" into tokens. This obviously is not something like a preprocessing phase, since this would not allow for catcode changes. Would the proper model be some combination of a token queue and a char queue, input reads from the token