Re: Re: Lucene and database

2006-07-05 Thread Erick Erickson
Alexander: You might also look through the mail archive for "database". There have been several dicsussions on that topic with input from people far more knowledgable than me that you might find relevant . Erick

Re: Re: Lucene and database

2006-07-04 Thread Giulio Cesare Solaroli
Alexander, to solve your problem, you have to carefully understand how lucene handles fields. Lucene can handle the value of the document fields in different ways; the different aspects to care of are: - indexing: whether the value is indexed or not. It may look strange to store data on a Lucene

Re: Lucene and database

2006-07-04 Thread Chris Lu
For your date interval search requirement, Lucene can do range search. You need to use ConstantScoreRangeQuery for better performance. You'd better select all your additional attributes into the lucene document. This will lead to some data duplications, especially look up values. But it's a trade

Re: Lucene and database

2006-07-04 Thread Michael D. Curtin
Alexander Mashtakov wrote: But, the database is going to be big enough, and the list of IDs returned by Lucene too. This may cause high memory usage and slow sql query speed (for instance 1000 IDs in "IN (id1, id2 ...)" sql filter) For this part, I recommend using a working table to hold the

Re: Lucene and database

2006-07-04 Thread Alexander Mashtakov
Thank you *Giulio,* I read some information about this approach. Is it possible to store in Lucene field several FKs ? For example, a document has serveral mappings to category table (N:M). The other question is about dates - is it possible to query Lucene for date interval (from -MM-DD to YY

Re: Lucene and database

2006-07-04 Thread Matthew Turland
If I'm understanding you correctly, you're using Lucene to store IDs and index the columns that would normally be full-text indices in MySQL, then use the IDs to retrieve the information from the database. This is more of a MySQL issue than a Lucene issue, but it suggests a flaw in your approach:

Re: Lucene and database

2006-07-04 Thread Giulio Cesare Solaroli
Hi Alexander, if the set of foreign keys you are using to filter the lucene results with some SQL query, I suggest you to include the foreign keys values as additional lucene fields, and let lucene return you the exact set of document IDs. I had excellent results with this technique. Hope this

Lucene and database

2006-07-04 Thread Alexander Mashtakov
Hi folks, I'm looking for a solution/best practices concerning Lucene and SQL database integration. The database (MySQL) is already developed and contains data. I've tried MySQL full-text search, but it's quite slow and doesn't have the possibility to intergate custom analyzers. Phrase search is

Re: lucene and database searching, keeping score

2005-12-02 Thread Jeff Rodenburg
George - There are a number of SQL Server specific ways you can do this. Email me off-list as the solution is not relevant to Lucene. -- j On 12/2/05, George Abraham <[EMAIL PROTECTED]> wrote: > > All, > I have created a Lucene index from data in a SQL Server db. When I conduct > a > Lucene sea

Re: lucene and database searching, keeping score

2005-12-02 Thread John Powers
Instead of just putting the keys in the index, can you put all the data you might be getting out to display to the user, or whatever the final thing is? That's what we do.Search on the id as you are, and then the hit has documents that are loaded with all your final information instead of just

lucene and database searching, keeping score

2005-12-02 Thread George Abraham
All, I have created a Lucene index from data in a SQL Server db. When I conduct a Lucene search, I get back in the hits the primary key (WorkID) and the scores associated with the hits. Then using the list of WorkIDs, I query the database for the other associated information of the assets associate

Lucene and database + location

2005-10-30 Thread Assad Jarrahian
location. The db (in my case postgres) consists of a table whose columns map to the above. So my question is two folds. 1) Lucene and database: So inherently while building a database it makes sense to index a few things (similar to Field.keyword). In this case I could make 'class' a