indic

We're going to be building some J2ME apps and Java/Rails webapps which will have a Kannada(a south indian language, for those who don't know much about India) UI. The UI and the data will both be in Kannada for these apps. So, we will need to write code containing some of these language text in the source code. I find it irritating that neither emacs nor XEmacs OR Jedit can edit any of these languages :-( Someone mentioned that a variant of Emacs can do it except I don't know if it works on Windows and where to get hold of it. I know notepad can do the trick BUT it's not a programmer's editor.

is there is any implementation of stemmers for indian languages like(hindi,telugu) are available .... Hindi Analyzer , with stemmer, is available in Lucene. It is based on this algorithm (pdf). hindi_stemmer is a Python implementation of the Hindi stemmer described in " A Lightweight Stemmer for Hindi " by Ananthakrishnan Ramanathan and Durgesh D Rao. import java.util.Map; import java.util.WeakHashMap; /** * Hindi light stemmer- removes number, gender and case suffixes from nouns and adjectives public class HindiStemmerLight{ /** * A cache of words and their stems */ static private Map<String,

I have something like a = "बिक्रम मेरो नाम हो" I want to achieve something like a[0] = बि a[1] = क्र a[3] = म but as म takes 4 bytes while बि takes 8 bytes I am not able to get to that straight. So what could be done to achieve that? In Python. The algorithm for splitting text into grapheme clusters is given in Unicode Annex 29 , section 3.1. I'm not going to implement the full algorithm for you here, but I'll show you roughly how to handle the case of Devanagari, and then you can read the Annex for yourself and see what else you need to implement. The unicodedata module contains the