Hi, the documentation is this file is not really up-to-date.
If you want to regenerate the jflex files, it is recommended to use the build script of Lucene. If you type "ant regenerate" or "ant jflex" (in the folder of the analysis module), the build system will download the correct version of JFlex and regenerate the scripts. Currently this is version 1.6.0. The warning was primarily there because of older versions of JFlex that used the Unicode version of the JVM which is no longer the case. Could you may be open an issue to update the documentation in the files? Uwe ----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -----Original Message----- > From: Youngho Cho [mailto:youngho1...@gmail.com] > Sent: Saturday, April 25, 2015 4:40 AM > To: java-user@lucene.apache.org > Subject: StandardTokenizerImpl generation question > > Hello, > > I would like to generate my own tokenizer which is slightly modify the > StandardTokenizerImpl*.jflex. > > But I read the READ_BEFORE_GENERATING.txt. > > Currently, the jflex version is 1.6.1. but the document recommend to use > jflex 1.5 only. > > Still this message is valid and do I have to generate a tokenizer using old > version of jflex ? > > > Thanks, > > Youngho > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
