Tokenizer?

[MisterX]

what is a tokenizer? ;0

> -----Original Message-----
> From: use-revolution-bounces at lists.runrev.com
> [mailto:use-revolution-bounces at lists.runrev.com]On Behalf Of K
> Sent: Friday, August 13, 2004 13:07
> To: use-revolution at lists.runrev.com
> Subject: Tokenizer?
> 
> 
> 
> Has anyone written a tokenizer that I can use in RR?  I am 
> working on rewriting the Gold Parser Engine but could use 
> something simple for the short term.
> 
> 
> 
> Kevin
> 
> 
> -==-=-=-=-=-=-==-=-=-=-=-=-=-=-==-=-=-=-=-=-
> Disclaimer:
> 
> Any resemblance between the above views and those of my
> employer, my terminal, or the view out my window are purely
> coincidental. 
> Any resemblance between the above and my own views is non-deterministic.
> 
>  The question of the existence of views in the absence of anyone to hold
> them
> is left as an exercise for the reader. The question of the existence of
> the reader
>  is left as an exercise for the second god coefficient. 
> (A discussion of non-orthogonal, non-integral polytheism is beyond the
> scope of this article.)
> 
> 
> 
> _______________________________________________
> Join Excite! - http://www.excite.com
> The most personalized portal on the Web!
> _______________________________________________
> use-revolution mailing list
> use-revolution at lists.runrev.com
> http://lists.runrev.com/mailman/listinfo/use-revolution