First of all, Java is not my usual language, so I\'m quite basic at it. I need to use it for this particular project, so please be patient, and if I have omitted any relevan
Om’s answer is good, but two other possibly useful approaches:
props.setProperty("tokenize.options", "untokenizable=NoneKeep");
.