[OT] editing index with Luke question
Hi, I know the Luke tool for browsing a Lucene index. From the description and the GUI I think it's also possible to edit index. But I have problems with that and I wonder if someone can help with this. What I did in Luke 3.4.0_1 is: - open an index - search for term -> get a list of matching documents - double click on a document -> document details are shown - click button "reconstruct & edit" -> dialog "Edit document" opens - change a field or path or ... - click button "Add to index" or "Delete old & add" - click menu file / commit changes -> red text in status line : "no changes - commit ignored" - if I repeat the search, the document does not contain my changes Best regards Michael - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
RE: [OT] editing index with Luke question
Hope you have write permission on this index file Vinaya -Original Message- From: Michael Südkamp [mailto:michael.suedk...@docware.de] Sent: Wednesday, December 14, 2011 3:16 PM To: java-user@lucene.apache.org Subject: [OT] editing index with Luke question Hi, I know the Luke tool for browsing a Lucene index. From the description and the GUI I think it's also possible to edit index. But I have problems with that and I wonder if someone can help with this. What I did in Luke 3.4.0_1 is: - open an index - search for term -> get a list of matching documents - double click on a document -> document details are shown - click button "reconstruct & edit" -> dialog "Edit document" opens - change a field or path or ... - click button "Add to index" or "Delete old & add" - click menu file / commit changes -> red text in status line : "no changes - commit ignored" - if I repeat the search, the document does not contain my changes Best regards Michael - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
AW: [OT] editing index with Luke question
sure -Ursprüngliche Nachricht- Von: Vinaya Kumar Thimmappa [mailto:vthimma...@ariba.com] Gesendet: Mittwoch, 14. Dezember 2011 11:06 An: java-user@lucene.apache.org Betreff: RE: [OT] editing index with Luke question Hope you have write permission on this index file Vinaya -Original Message- From: Michael Südkamp [mailto:michael.suedk...@docware.de] Sent: Wednesday, December 14, 2011 3:16 PM To: java-user@lucene.apache.org Subject: [OT] editing index with Luke question Hi, I know the Luke tool for browsing a Lucene index. From the description and the GUI I think it's also possible to edit index. But I have problems with that and I wonder if someone can help with this. What I did in Luke 3.4.0_1 is: - open an index - search for term -> get a list of matching documents - double click on a document -> document details are shown - click button "reconstruct & edit" -> dialog "Edit document" opens - change a field or path or ... - click button "Add to index" or "Delete old & add" - click menu file / commit changes -> red text in status line : "no changes - commit ignored" - if I repeat the search, the document does not contain my changes Best regards Michael - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org -- This message was scanned by ESVA and is believed to be clean. Click here to report this message as spam. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Payload instance and byte buffer instance re-use
Hi,
Is it safe to reuse a Payload instance within a TokenStream/Filter? I
think about something like this :
public final boolean incrementToken() throws IOException {
[...]
if(payloadAttribute.getPayload() == null) {
payloadAttribute.setPayload(new Payload());
}
payloadAttribute.getPayload().setData(myWorkingBuffer, 0,
myWorkingBufferLength);
return true;
}
Before, I always passed a new Payload instance with a fresh byte[] copy,
I'm testing this optimization and my first tests are successful. As I'm
not aware of all indexing scenarios I'm afraid of some cases where
payload instance or data could be buffered and then overwritten by
myself while building the next token.
Thanks for your help.
--
David Causse
Spotter
http://www.spotter.com/
-
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
Broken link in Lucene 3.5 JavaDoc?
Hi, is there broken link in http://lucene.apache.org/java/3_5_0/api/all/org/apache/lucene/facet/package-summary.html ? There is a link pointing to http://lucene.apache.org/java/3_5_0/api/all/userguide.html resulting into 404. Regards, Lukas
Re: Broken link in Lucene 3.5 JavaDoc?
I will investigate it. In the meantime, this is the correct link: http://lucene.apache.org/java/3_5_0/api/contrib-facet/userguide.html Shai On Wed, Dec 14, 2011 at 3:08 PM, Lukáš Vlček wrote: > Hi, > > is there broken link in > > http://lucene.apache.org/java/3_5_0/api/all/org/apache/lucene/facet/package-summary.html > ? > There is a link pointing to > http://lucene.apache.org/java/3_5_0/api/all/userguide.html resulting into > 404. > > Regards, > Lukas >
Re: Broken link in Lucene 3.5 JavaDoc?
Looks like a problem in the javadocs-all task that combines the core and contribs. Maybe the build should inline the userguide directly into package-summary.html so that you see it no matter how you get to the o.a.l.facet package? On Wed, Dec 14, 2011 at 8:14 AM, Shai Erera wrote: > I will investigate it. In the meantime, this is the correct link: > http://lucene.apache.org/java/3_5_0/api/contrib-facet/userguide.html > > Shai > > On Wed, Dec 14, 2011 at 3:08 PM, Lukáš Vlček wrote: > >> Hi, >> >> is there broken link in >> >> http://lucene.apache.org/java/3_5_0/api/all/org/apache/lucene/facet/package-summary.html >> ? >> There is a link pointing to >> http://lucene.apache.org/java/3_5_0/api/all/userguide.html resulting into >> 404. >> >> Regards, >> Lukas >> -- lucidimagination.com - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: Is indexing much slower in 3.5.0 than in 2.4.1 for Wikipedia data?
On Tue, Dec 13, 2011 at 4:45 PM, Sean Tong wrote: > Hi, > > I modified the DocMaker in 3.5 to make it index the same 4 fields as 2.4.1 > does. Now I got very similar stats in the index by checking Luke. The index > performance was slightly better than that by indexing 7 fields but still not > comparable with the 2.4.1 performance: > > [java] > Report sum by Prefix (MAddDocs) and Round (3 about 3 out > of 14) > [java] Operation round flush mrg runCnt recsPerRun rec/s > elapsedSec avgUsedMem avgTotalMem > [java] MAddDocs_20 0 16.00 10 1 20 767.18 > 260.70 113,206,984 144,637,952 > [java] MAddDocs_20 - 1 16.00 10 - - 1 - - 20 - - 801.61 > - - 249.50 - 117,778,992 - 144,637,952 > [java] MAddDocs_20 2 16.00 10 1 20 734.39 > 272.33 121,479,568 126,287,872 > > Maybe there are some other settings that make the benchmarks not comparable. I think for benchmarking, this CloseIndex task should default to doWait=false... maybe try passing that parameter to it. -- lucidimagination.com - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: [OT] editing index with Luke question
You may have to re-open the index. Also, is there any option to commit? I have to admit I haven't tried this... Best Erick On Wed, Dec 14, 2011 at 5:08 AM, Michael Südkamp wrote: > sure > > -Ursprüngliche Nachricht- > Von: Vinaya Kumar Thimmappa [mailto:vthimma...@ariba.com] > Gesendet: Mittwoch, 14. Dezember 2011 11:06 > An: java-user@lucene.apache.org > Betreff: RE: [OT] editing index with Luke question > > Hope you have write permission on this index file > > Vinaya > > -Original Message- > From: Michael Südkamp [mailto:michael.suedk...@docware.de] > Sent: Wednesday, December 14, 2011 3:16 PM > To: java-user@lucene.apache.org > Subject: [OT] editing index with Luke question > > Hi, > > I know the Luke tool for browsing a Lucene index. From the description and > the GUI I think it's also possible to edit index. But I have problems with > that and I wonder if someone can help with this. > What I did in Luke 3.4.0_1 is: > - open an index > - search for term -> get a list of matching documents > - double click on a document -> document details are shown > - click button "reconstruct & edit" -> dialog "Edit document" opens > - change a field or path or ... > - click button "Add to index" or "Delete old & add" > - click menu file / commit changes -> red text in status line : "no changes - > commit ignored" > - if I repeat the search, the document does not contain my changes > > Best regards > > Michael > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > -- > This message was scanned by ESVA and is believed to be clean. > Click here to report this message as spam. > > > > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
AW: [OT] editing index with Luke question
Yes I tried this. I update (delete & add) my document now with a small program through Lucene directly so I don't rely on Luke anymore here. Thanks to everyone who tried to help. Michael -Ursprüngliche Nachricht- Von: Erick Erickson [mailto:erickerick...@gmail.com] Gesendet: Mittwoch, 14. Dezember 2011 14:37 An: java-user@lucene.apache.org Betreff: Re: [OT] editing index with Luke question You may have to re-open the index. Also, is there any option to commit? I have to admit I haven't tried this... Best Erick On Wed, Dec 14, 2011 at 5:08 AM, Michael Südkamp wrote: > sure > > -Ursprüngliche Nachricht- > Von: Vinaya Kumar Thimmappa [mailto:vthimma...@ariba.com] > Gesendet: Mittwoch, 14. Dezember 2011 11:06 > An: java-user@lucene.apache.org > Betreff: RE: [OT] editing index with Luke question > > Hope you have write permission on this index file > > Vinaya > > -Original Message- > From: Michael Südkamp [mailto:michael.suedk...@docware.de] > Sent: Wednesday, December 14, 2011 3:16 PM > To: java-user@lucene.apache.org > Subject: [OT] editing index with Luke question > > Hi, > > I know the Luke tool for browsing a Lucene index. From the description and > the GUI I think it's also possible to edit index. But I have problems with > that and I wonder if someone can help with this. > What I did in Luke 3.4.0_1 is: > - open an index > - search for term -> get a list of matching documents > - double click on a document -> document details are shown > - click button "reconstruct & edit" -> dialog "Edit document" opens > - change a field or path or ... > - click button "Add to index" or "Delete old & add" > - click menu file / commit changes -> red text in status line : "no changes - > commit ignored" > - if I repeat the search, the document does not contain my changes > > Best regards > > Michael > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > -- > This message was scanned by ESVA and is believed to be clean. > Click here to report this message as spam. > > > > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org -- This message was scanned by ESVA and is believed to be clean. Click here to report this message as spam. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: How to use setWriteLockTimeout(long) when write.lock already exists
Am 13.12.11 19:36, schrieb Michael Wechner: Hi According to http://www.gossamer-threads.com/lists/lucene/java-dev/37421 one cannot overwrite the default write lock timeout of 1000ms once a write.lock already exists (for example inside a multi-threaded web-application), because in order to use the method setWriteLockTimeout(long) one would have to first create an instance of IndexWriter, but because write.lock already exists the creation will throw a LockObtainFailedException and hence once does not get an instance. In the link above "Mike" is mentioned that he will create a Jira issue, but it's not clear to me if it ever got created and/or that somebody tried to improve this. Any idea? I think I have found the JIRA issue mentioned in the above email thread: https://issues.apache.org/jira/browse/LUCENE-621 and according to the test class one can set the timeout ahead of initializing the IndexWriter IndexWriter.setDefaultWriteLockTimeout(2000); IndexWriter.setDefaultCommitLockTimeout(2000); IndexWriter writer = new IndexWriter(dir, new WhitespaceAnalyzer(), true); This seems to work fine. Thanks Michael Just as a suggestions, but I think it would be nice if one could create an IndexWriter instance without actually opening the index in the first place, but rather something like: IndexWriter iWriter = new IndexWriter(); iWriter.setDirectory(...); iWriter.setAnalyzer(); iWriter.setWriteLockTimeout(75); iWriter.open(); // or iWriter.checkout(); // do something with the index iWriter.close(); WDYT? Thanks Michael - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: highlighter: how can I get locations of fragments?
: Subject: highlighter: how can I get locations of fragments? : References: <4ee79b27.1010...@wyona.com> : In-Reply-To: <4ee79b27.1010...@wyona.com> https://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even if you change the subject line of your email, other mail headers still track which thread you replied to and your question is "hidden" in that thread and gets less attention. It makes following discussions in the mailing list archives particularly difficult. -Hoss - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: Broken link in Lucene 3.5 JavaDoc?
If you access this URL: http://lucene.apache.org/java/3_5_0/api/contrib-facet/ then the link to the userguide points to the correct location. I've tried to add it to package.html, but it doesn't look very good. I will fix javadocs-all to copy the userguide to the correct location, as facet-userguide. Shai On Wed, Dec 14, 2011 at 3:21 PM, Robert Muir wrote: > Looks like a problem in the javadocs-all task that combines the core > and contribs. > > Maybe the build should inline the userguide directly into > package-summary.html so that you see it no matter how you get to the > o.a.l.facet package? > > On Wed, Dec 14, 2011 at 8:14 AM, Shai Erera wrote: > > I will investigate it. In the meantime, this is the correct link: > > http://lucene.apache.org/java/3_5_0/api/contrib-facet/userguide.html > > > > Shai > > > > On Wed, Dec 14, 2011 at 3:08 PM, Lukáš Vlček > wrote: > > > >> Hi, > >> > >> is there broken link in > >> > >> > http://lucene.apache.org/java/3_5_0/api/all/org/apache/lucene/facet/package-summary.html > >> ? > >> There is a link pointing to > >> http://lucene.apache.org/java/3_5_0/api/all/userguide.html resulting > into > >> 404. > >> > >> Regards, > >> Lukas > >> > > > > -- > lucidimagination.com > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > >
