Word chunk includes punctuation

[Peter M. Brigham]

On Aug 13, 2012, at 2:20 PM, Paul Dupuis wrote:

> The documentation also doesn't mention that ? works as a token per
> Mark's post, so perhaps my caution is unwarranted.

Hmmm. For me,
   put token 1 of ("test1?test2")
gives
   test1?test2
so questionmark does not seem to be either a token or a tokendelimiter.

2008 MacBook, OSX 10.7.4 (Lion), Rev Studio 4.5.3, build 1210

-- Peter

Peter M. Brigham
pmbrig at gmail.com
http://home.comcast.net/~pmbrig