Determining the language of the text

[xavier.bury at clearstream.com]

Hi Ron

Im working on a detector for non-unicode languages. Is there a way to tell 
if text is in unicode or not?

Detecting languages can be done via a dictionary exlusion - if the word is 
not in the dictionary, try
next dictionary... 

SpellNO2 spell checking plugin has this feature planned... but im not 
working hard on it as demand was dismall...

cheers
Xavier

use-revolution-bounces at lists.runrev.com wrote on 21/10/2005 09:28:13:

> Hi again,
> 
> This is an attempt to get at my problem a different way. Is there a way 
> to tell what language a given chunk of text is?
> 
> If I ask for user input, it may be in english or japanese or korean for 
> example. If I need to unidecode the text, I need to know if it is 
> japanese or korean. If it is english, I may not even need to unidecode 
> for my purposes.
> 
> So, is there a way to tell what language a given chunk is in?
> 
> Thanks,
> Ron
> 
> _______________________________________________
> use-revolution mailing list
> use-revolution at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your 
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-revolution



-----------------------------------------
To make communications with Clearstream easier, Clearstream has
recently changed the email address format to conform with industry
standards. The new format is 'firstname.familyname at clearstream.com'.


Visit us at http://www.clearstream.com
                                                          
IMPORTANT MESSAGE

Internet communications are not secure and therefore Clearstream
International does not accept legal responsibility for the contents of
this message.

The information contained in this e-mail is confidential and may be
legally privileged. It is intended solely for the addressee. If you are
not the intended recipient, any disclosure, copying, distribution or
any action taken or omitted to be taken in reliance on it, is
prohibited and may be unlawful. Any views expressed in this e-mail are
those of the individual sender, except where the sender specifically
states them to be the views of Clearstream International or of any of
its affiliates or subsidiaries.

END OF DISCLAIMER