Word chunk includes punctuation

[Bob Sneidar]

From the dictionary:
1. Each of the following characters is a token: =, +, -, *, /, [, ], (, ), {, }, <, >, and comma (,).

2. Each of the following characters is a token delimiter: ; (semicolon), space, return, and tab.

So no, a question mark is NOT a delimiter. In this the dictionary speaks true. 

Bob


On Aug 14, 2012, at 8:37 AM, Peter M. Brigham wrote:

> On Aug 13, 2012, at 2:20 PM, Paul Dupuis wrote:
> 
>> The documentation also doesn't mention that ? works as a token per
>> Mark's post, so perhaps my caution is unwarranted.
> 
> Hmmm. For me,
>   put token 1 of ("test1?test2")
> gives
>   test1?test2
> so questionmark does not seem to be either a token or a tokendelimiter.
> 
> 2008 MacBook, OSX 10.7.4 (Lion), Rev Studio 4.5.3, build 1210
> 
> -- Peter
> 
> Peter M. Brigham
> pmbrig at gmail.com
> http://home.comcast.net/~pmbrig
> 
> 
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode