problem with eclipse and lucene 1.9.1

2006-05-17 Thread Amir Hosein Jadidi Nejad
Hi All, I want to use lucene1.9.1 in Eclipse IDE in windows platform, but i can't create new project with "Java Project from Existing Ant Buildfile" in "New Project" window. when i use "build.xml" in top level of lucene source folder, following error is occur : "specified buildfile does not cont

Re: Theoretical Lucene Performance

2006-05-17 Thread Mike Richmond
Hello Andreas, This may also be a good reference for you: http://lucene.apache.org/java/docs/fileformats.html --Mike On 5/16/06, Andreas Harth <[EMAIL PROTECTED]> wrote: Hello, I'd like to learn a bit more about the index organization of Lucene (ideally without sifting through source code).

Re: question about custom sort method

2006-05-17 Thread Yonik Seeley
FunctionQuery could also be used for this. http://incubator.apache.org/solr/docs/api/org/apache/solr/search/function/FunctionQuery.html -Yonik http://incubator.apache.org/solr Solr, the open-source Lucene search server On 5/17/06, Peter Keegan <[EMAIL PROTECTED]> wrote: Suppose I have a custom

Re: question about custom sort method

2006-05-17 Thread Peter Keegan
Suppose I have a custom sorting 'DocScoreComparator' for computing distances on each search hit from a specified coordinate (similar to the DistanceComparatorSource example in LIA). Assume that the 'specified coordinate' is different for each query. This means a new custom comparator must be creat

Re: Boost problems

2006-05-17 Thread Otis Gospodnetic
I see you already got 2 answers. However, judging from your source, it looks like you are really using the .Net port of Lucene, so a better place to ask would be the lucene.net mailing list. Otis - Original Message From: Marcus Falck <[EMAIL PROTECTED]> To: java-user@lucene.apache.org

Re: Boost problems

2006-05-17 Thread Daniel Naber
On Mittwoch 17 Mai 2006 15:43, Marcus Falck wrote: > Why does it reply with 1 as boost? Shouldn't this value be 2? No, these values are normalized and/or mixed with other values internally and cannot be re-fetched in their original form. Regards Daniel -- http://www.danielnaber.de -

Re: Boost problems

2006-05-17 Thread Chris Hostetter
Document boosts are folded into the individual fieldNorms when the document is indexed -- they are not accessible from the Document object returned after doing search. This is mentioned in the javadocs for Document.getBoost ... at least it is in 1.9, I'm not sure about 1.4. : Date: Wed, 17 May

RE: Building queries

2006-05-17 Thread Chris Hostetter
: This kinda leads me back to my "best practises" question: If Im building : up the query dynamically based off of several fields (rather than the : user entering a Lucene Query), Im kind of wondering If I should be using : query parser at all...?! I keep feeling that maybe I should just be : buil

Boost factor in MultiFieldQueryParser

2006-05-17 Thread Suman Ghosh
Hi all,I am evaluating Lucene 1.9 for a search application. I am using MultiFieldQueryParser for searching across fields and everything works fine. However, we have a new requirement where certain fields need to be boosted while searching. To complicate matters, users can specify fields while sear

Re: Changing the scoring (newest doc date first)

2006-05-17 Thread Yonik Seeley
On 5/16/06, Marcus Falck <[EMAIL PROTECTED]> wrote: I'm working on a very large implementation of a search engine based on the lucene api (1.4.3). We have also been investigating enterprise search companies such as FAST and Verity but have come to the conclusion that we might aswell save ourse

RE: Changing the scoring (newest doc date first)

2006-05-17 Thread Mordo, Aviran (EXP N-NANNATEK)
When you write your query, you can add a date range with a boot factor for this field, i.e boost y a factor x the documents that have a date of today, boost by x-1 the documents from the past wee, boost by x-2 the documents from the past two weeks, etc'. This will not be a perfect sort on the dat

RE: adding new fields to index

2006-05-17 Thread Mordo, Aviran (EXP N-NANNATEK)
No, Lucene does not have an update index option, you need to reindex Aviran http://www.aviransplace.com -Original Message- From: Harini Raghavan [mailto:[EMAIL PROTECTED] Sent: Wednesday, May 17, 2006 12:59 PM To: java-user@lucene.apache.org Subject: adding new fields to index Hi All,

adding new fields to index

2006-05-17 Thread Harini Raghavan
Hi All, I have an existing lucene index whose size is around 10G. I need to add/delete some fields for all the documents in the index. Is there any way to do this without reindexing all the documents again? Thanks, Harini - To

Re: Some documents are not added to the index

2006-05-17 Thread Yonik Seeley
On 5/17/06, Martin Kobele <[EMAIL PROTECTED]> wrote: > There may also be a bug in your code that adds the 512 documents (not > synchronizing the clients properly could cause your count to be off). luke tells me how many documents are in my index. I open the index in luke after I closed my app. al

Re: Some documents are not added to the index

2006-05-17 Thread Martin Kobele
On Wednesday 17 May 2006 09:55, karl wettin wrote: > I can only guess out of the blue. Do you clear the index now and then > when creating a new IndexWriter? You say there is only one instance of > that so that would not be it then. how do I clear the index? I create an IndexWriter with the create

Re: Some documents are not added to the index

2006-05-17 Thread Martin Kobele
On Wednesday 17 May 2006 12:03, Yonik Seeley wrote: > On 5/17/06, Martin Kobele <[EMAIL PROTECTED]> wrote: > > several threads add document to the same index. > > As noted in the FAQ, adding documents is thread safe. > > (I even synchronize my static index writer when I add documents. just to > > m

Re: Some documents are not added to the index

2006-05-17 Thread Yonik Seeley
On 5/17/06, Martin Kobele <[EMAIL PROTECTED]> wrote: several threads add document to the same index. As noted in the FAQ, adding documents is thread safe. (I even synchronize my static index writer when I add documents. just to make sure.) However, after addind all my documents, the index does n

Re: Sort problematics

2006-05-17 Thread Yonik Seeley
On 5/17/06, Marcus Falck <[EMAIL PROTECTED]> wrote: I did a quite interesting notice, if i search for IndexId:x (IndexId is unique) with a sort it still takes very long time, which it doesn't without the sort. This will only be the case the first time you sort on a field because a FieldCache

RE: Building queries

2006-05-17 Thread Irving, Dave
Hey - thanks Marc - that's really useful information, thanks so much! Its really good to hear that someone has already used the "field metadata" approach - and I definitely think it's the route I'll now be taking :o) Thanks, Dave > -Original Message- > From: Marc Dauncey [mailto:[EMAIL P

Re: Building queries

2006-05-17 Thread Marc Dauncey
I'm working on designing this kind of meta configuration on top of some Lucene indexes right now. The company I work for has several different "products" which have to be indexed and searched, each with their own field list. Sometimes products will map to many individual Lucene indexes. The s

Re: Some documents are not added to the index

2006-05-17 Thread karl wettin
On Wed, 2006-05-17 at 09:38 -0400, Martin Kobele wrote: > On Wednesday 17 May 2006 09:09, karl wettin wrote: > > On Wed, 2006-05-17 at 09:02 -0400, Martin Kobele wrote: > > > How can I check whether a document was actually added? > > > Is there another way to monitor whether the doc was added? > >

Boost problems

2006-05-17 Thread Marcus Falck
Hello, I have run in to problems regarding boosting of documents, using lucene.net 1.4.3 (so if anybody runs the java version and feel for running my posted source code please do so and see if the result is the same). The following code: // The following example illustrates the boos

Re: Building queries

2006-05-17 Thread Erik Hatcher
On May 17, 2006, at 8:19 AM, Irving, Dave wrote: First - thanks for Lucene! I started working with it a few days ago, bought the Lucene In Action book, and Im very impressed with both. Thank you for the latter! For the former, thanks go to Doug and many others. Im integrating search in t

Re: Some documents are not added to the index

2006-05-17 Thread Martin Kobele
On Wednesday 17 May 2006 09:09, karl wettin wrote: > On Wed, 2006-05-17 at 09:02 -0400, Martin Kobele wrote: > > How can I check whether a document was actually added? > > Is there another way to monitor whether the doc was added? > > Luke is your friend when it comes to inspecting indices. >

RE: Building queries

2006-05-17 Thread Irving, Dave
Hi, ... >> So, I just need to run the terms entered by the user in each field >> against the appropriate analyser, and build up the query that way. >> Does that sound like a sensible approach? Are there any >> code samples >> around showing how to run search phrases through analysers >> and

Re: Sort problematics

2006-05-17 Thread karl wettin
On Wed, 2006-05-17 at 14:23 +0200, Marcus Falck wrote: > > I did a quite interesting notice, if i search for IndexId:x > (IndexId is unique) with a sort it still takes very long time, which > it doesn't without the sort. > > Does anybody know why? I mean the resultset contains exactly 1 > doc

Some documents are not added to the index

2006-05-17 Thread Martin Kobele
Hi, several threads add document to the same index. As noted in the FAQ, adding documents is thread safe. (I even synchronize my static index writer when I add documents. just to make sure.) However, after addind all my documents, the index does not contain all of the documents. When I run it a

Re: Building queries

2006-05-17 Thread Erick Erickson
See below... 1) Are there any "best / common practises" for this that I've missed during my web searches and reading of Lucene in Action? OF COURSE there are , but I don't know where they are either.. 2) I don't want to release the full query syntax to users: So I'll probably have multiple

Re: lucene

2006-05-17 Thread Erick Erickson
Alberto: Not a problem. You can add more data to an index even as it is being read by your application. HOWEVER, you must close and reopen your IndexReaders before the newly-indexed data is available to the readers. This is an expensive operation, so I would close/open the IndexReader judiciousl

Sort problematics

2006-05-17 Thread Marcus Falck
I did a quite interesting notice, if i search for IndexId:x (IndexId is unique) with a sort it still takes very long time, which it doesn't without the sort. Does anybody know why? I mean the resultset contains exactly 1 document. /Regards Marcus

Building queries

2006-05-17 Thread Irving, Dave
Hi, First - thanks for Lucene! I started working with it a few days ago, bought the Lucene In Action book, and Im very impressed with both. Im integrating search in to an existing pet-project web application where new fields for index / search may be added via configuration. My idea is to have a

lucene

2006-05-17 Thread Alberto Marquÿffffe9s
My question if is once created indices in a directory I I can add more indices without having to erase the previous directory that already I have created. Since I need to be continuously adding files indice, thus not if Lucene does what I need. My language is the Spanish does not exist sup