New chunks

[Mark Wieder]

Richmond <richmondmathewson at ...> writes:

> How are you going to work out what marks a sentence boundary in every 
> language that one can write
> with Unicode? And there are languages where the idea of a 'sentence' is 
> absent.

My initial take on this was the same as yours. But unicode separators seem
to have been well thought-out (or at least standardized <g>):

http://www.unicode.org/reports/tr29/
http://www.unicode.org/Public/6.3.0/ucd/auxiliary/SentenceBreakTest.html

and I think any discussion or arguments should be taken up with the unicode
working group, and not have LC create Yet Another Variation on the way folks
will expect things to work.

-- 
 Mark Wieder
 ahsoftware at gmail.com