Ok, got this working with one small caveat
If the token starts with a comma, e.g. - ,dummy
I'd like to remove the comma like so
public override bool IncrementToken()
{
else if (bufferLength > 1 && buffer[0] == ',' )
{
// strip the starting
I did search google on TokenFilter lucene example and found this link
http://sujitpal.blogspot.com/2011/07/lucene-token-concatenating-tokenfilter_
30.html
which seems to override incrementToken() ( guess as I don't know java )
however using lucene.net 3.0.3, I can override
public overrid
