I still need all the normal benefits of the StandardAnalyzer as far as
punctuation and everything else goes, with just this one special exception.
Since I was on a limited schedule I ended up just doing the method where I
escape these cases myself in a way that makes them get tokenized. Certainly
Let's take a quick step back and see if it helps. Why do you feel you
need the StandardAnalyzer to solve your problem? What else are you
gaining from it? Would you be better served by a WhitespaceTokenizer?
That being said, hacking up the grammar isn't as bad as you might
think. There a