On Jul 18, 2018, at 10:21 AM, Paul Berger via cctalk <cctalk@classiccmp.org> 
wrote:

> I would think that any interpreted BASIC would do this or for that matter any 
> interpreted language except maybe for APL 

You'd think so but many BASIC dialects don't fully tokenize. Many leave in all 
the extra spaces the user types in, such as the Microsoft BASIC on various 
Commodores. Some BASICs even require the spaces in order to properly parse 
during tokenization.

There's a page here which includes a field for machines which do full 
tokenization:

https://en.wikipedia.org/wiki/List_of_computers_with_on-board_BASIC

--
Follow me on twitter: @FozzTexx
Check out my blog: http://insentricity.com

Reply via email to