Unicode and chunk expressions

[Richard Gaskin]

Dar Scott wrote:
> 
> On May 17, 2005, at 11:57 AM, Richard Gaskin wrote:
> 
>> I need to dive into Unicode and it seems there are a number of 
>> limitations, among these the loss of chunk expressions when working 
>> with double-byte languages.  Is that correct?
>>
>> The app I'm working on for that makes extensive use of chunk 
>> expressions -- am I back to the old-school-language methods of walking 
>> through every character to parse it?
> 
> 
> You can convert to UTF8 and then work with the chunk expression for line 
> and item and (maybe word).

Forgive my ignorance, but how can UTF8 be used with two-byte systems 
like Chinese?  I was under the impression those had to be UTF16.

--
  Richard Gaskin
  Fourth World Media Corporation
  __________________________________________________
  Rev tools and more: http://www.fourthworld.com/rev