ANTLR: Unicode Character Scanning

Question

Problem: Can\'t get Unicode character to print correctly.

Here is my grammar:

options { k=1; filter=true;
 // Allow any char but \\uFFFF (16 bit -1)
char         


        

Answer 1

Your problem is not in the ANTLR generated lexer, but in the Java stream you pass to it. The stream reads bytes only (doesn't interpret them in an encoding), and what you see is an UTF-8 sequence.

If its ANTLR 3, you can use the ANTLRInputStream constructor that takes an ancoding as a parameter:

ANTLRInputStream (InputStream input, String encoding) throws IOException