Re: Query joining 2 indexes

2009-12-18 Thread frer
ch, > > François > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > -- View this message in conte

Re: Query joining 2 indexes

2009-12-18 Thread frer
ents, locate the Hourly Index Id and fetch >> it. >> >> >> >> Therefore I make 501 requests to lucene. This causes some performance >> >> issues I guess because of the overhead to making a request to Lucene. >> >> >> >> Is it possible to do this in

Re: Query joining 2 indexes

2009-12-18 Thread Erick Erickson
I guess it would be possible to build a query with my 500 hourly > >> ids > >> and make a OR between them to make it in 2 requestsbut then I have > to > >> find the matching documents. Will this overflow if I have 5 ids in > >> my > >> quer

Re: Query joining 2 indexes

2009-12-18 Thread frer
>> >> If not I guess it would be possible to build a query with my 500 hourly >> ids >> and make a OR between them to make it in 2 requestsbut then I have to >> find the matching documents. Will this overflow if I have 5 ids in >> my >> query? >> >> Anyway, I just want advice on how one would a

Re: Query joining 2 indexes

2009-12-18 Thread Erick Erickson
Well, making a large OR clause is definitely more efficient than making N different requests, but you would have to search the results. It doesn't sound very performant. Could you go to 50,000 ids? yes, but you have to fiddle with setMaxClauseCount because Lucene defaults to a max of 1,024. There

Query joining 2 indexes

2009-12-18 Thread François Eric
Hello, I have a performance problem and would need expert advice on how to go about fixing it: I currently have 2 indexes: Daily and Hourly. The Daily index contains about 1,000,000 documents and my Hourly index approximately: 24,000,000 documents. My Daily index contains many fields and s