Re: Complete phrase Suggest Feature in Apache Lucene

2013-08-02 Thread Ankit Murarka
Hello Koji. I understand only English. Unfortunately the link you shared contains slides which I dont know is present in which Language !! If possible please share the slides in English language. Many thanks for the help. On 8/2/2013 9:04 PM, Koji Sekiguchi wrote: (13/08/02 17:16), Ankit Murar

PhraseQuery Search

2013-08-02 Thread raghavendra.k.rao
Hi, I have been using the regular Query class to search single keywords. I needed to include hits such as "BANKER" if the user searched for "BANK". To achieve this I used "*" on both sides as *BANK*. Now I need to search for phrases and I am building a PhraseQuery. My question is, is there a w

Re: Lucene 4.3.1 CheckIndex limitation 100 trillion tokens?

2013-08-02 Thread Robert Muir
Thanks, this is what I expected. I opened an issue to remove seek by Ord from this vectors format. On Aug 2, 2013 2:13 PM, "Tom Burton-West" wrote: > Thanks Robert, > > Looks like it switches between seekCeil and seekExact: > > "main" prio=10 tid=0x0e79a000 nid=0x5fe5 runnable > [0x2b

Re: Lucene 4.3.1 CheckIndex limitation 100 trillion tokens?

2013-08-02 Thread Tom Burton-West
Thanks Robert, Looks like it switches between seekCeil and seekExact: "main" prio=10 tid=0x0e79a000 nid=0x5fe5 runnable [0x2b32de0cc000] jstack.out3- java.lang.Thread.State: RUNNABLE jstack.out3-at org.apache.lucene.codecs.compressing.CompressingTermVectorsReader$TVTermsEnum.see

Re: Join Util with Filter Queries

2013-08-02 Thread Martijn v Groningen
Hi, If you specify the FilteredQuery via the 'fromQuery' parameter, then they should be executed before the the join operation is performed. What makes you think that the FilteredQuery is applied post join? Martijn On 1 August 2013 22:33, Shane Strasser wrote: > Hey All, > > We're currently l

Re: Complete phrase Suggest Feature in Apache Lucene

2013-08-02 Thread Koji Sekiguchi
(13/08/02 17:16), Ankit Murarka wrote: Hello All, Just like spellcheck feature which after lot of trouble was Implemented, is it possible to implement Complete Phrase Suggest Feature in Lucene 4.3 . So if I enter an incorrect phrase it can suggest me few possible valid phrases. One way could

RE: lucene 4.3 seems to be much slower in indexing than lucene 3.6?

2013-08-02 Thread Zhang, Lisheng
I should have mentioned the commands I used to test: 1/ Index: java TestReal36 index -fileFolder /home/cvsupport/lzhang/files -optimize false java TestReal43 index -fileFolder /home/cvsupport/lzhang/files -optimize false The fileFolder contains 8 *.txt files with UTF-8 encoding. I also tried with

Re: Complete phrase Suggest Feature in Apache Lucene

2013-08-02 Thread Ivan Krišto
On 08/02/2013 10:16 AM, Ankit Murarka wrote: > is it possible to implement Complete Phrase Suggest Feature in Lucene > 4.3 . So if I enter an incorrect phrase it can suggest me few possible > valid phrases. > > One way could be to get suggestion for each word in the sentence and > calling SpellChec

Re: IndexUpgrade - Any ways to speed up?

2013-08-02 Thread Shai Erera
Unfortunately you cannot upgrade directly from 2.3.1 to 4.1. You can consider upgrading to 3.6.2 and stop there. Lucene 4.1 can read 3.x indexes, and when segments will are merged, they are upgraded automatically to the newest file format. However, if this single segment is too big, such that it w

Re: IndexUpgrade - Any ways to speed up?

2013-08-02 Thread Ramprakash Ramamoorthy
Thank you Shai for the quick response. Have responded inline. On Fri, Aug 2, 2013 at 5:37 PM, Shai Erera wrote: > Hi > > You cannot just update headers -- the file formats have changed. Therefore > you need to rewrite the index entirely, at least from 2.3.1 to 3.6.2 (for > 4.1 to be able to rea

Re: IndexUpgrade - Any ways to speed up?

2013-08-02 Thread Shai Erera
Hi You cannot just update headers -- the file formats have changed. Therefore you need to rewrite the index entirely, at least from 2.3.1 to 3.6.2 (for 4.1 to be able to read it). If your index is already optimized, then IndexUpgrader is your best option. The reason it calls forceMerge(1) is that

IndexUpgrade - Any ways to speed up?

2013-08-02 Thread Ramprakash Ramamoorthy
Team, We are migrating from lucene version 2.3.1 to 4.1. We are migrating the indices as well, and we do this in two steps 2.3.1 to 3.6.2 and 3.6.2 to 4. We just call IndexUpgrader.upgrade(), using the IndexUpgraderMergePolicy. I see that, the upgrade() method actually calls a forcemerge(1

Re: Lucene 4 - Faceted Search with Sorting

2013-08-02 Thread Shai Erera
Hi Basically, every IndexSearch.search() variant has a matching Collector. They are there for easier usage by users. TopFieldCollector.create() takes searchAfter (TopFieldDoc), so you can use it in conjunction with FacetsCollector as I've outlined before. In general you're right that for paginati

Complete phrase Suggest Feature in Apache Lucene

2013-08-02 Thread Ankit Murarka
Hello All, Just like spellcheck feature which after lot of trouble was Implemented, is it possible to implement Complete Phrase Suggest Feature in Lucene 4.3 . So if I enter an incorrect phrase it can suggest me few possible valid phrases. One way could be to get suggestion for each word in