New chunks

[Fraser Gordon]

On 13 Mar 2014, at 04:48, Jim Hurley <jhurley0305 at sbcglobal.net> wrote:
> 
> So I really can't see the purpose of RR's "sentence chunk". I wish they would explain.
> 

We'd be using ICU's sentence breaking code. They include a whole bunch of language-related knowledge with the library and can use that to tell the difference between decimal points, full stops, abbreviations, etc. You're right about it not being perfect but it does seem pretty reliable.

Regards,
Fraser