Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-05-01 Thread Paul Elschot
s in QueryParser. Regards, Paul Elschot > > -Rico > > Original-Nachricht > Datum: Mon, 30 Apr 2007 15:08:14 -0700 > Von: "Mike Klaas" <[EMAIL PROTECTED]> > An: java-user@lucene.apache.org > Betreff: Re: Re: How to index a lot of fields (with

Re: Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-30 Thread Chris Hostetter
: However, it does not look like upgrading is an option, so I wonder if my : current approach of mapping a property that a client app creates to one : field name is workable at all. Maybe I have to introduce some sort of : mapping of client properties to a fixed number of indexable fields. : : ...

Re: Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-30 Thread pbm-rico
: How to index a lot of fields (without FileNotFoundException: Too many open files) > On 4/30/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > Thanks for you reply. > > > > We are still using Lucene v1.4.3 and I'm not sure if upgrading is an > option. Is

Re: Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-30 Thread Mike Klaas
On 4/30/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: Thanks for you reply. We are still using Lucene v1.4.3 and I'm not sure if upgrading is an option. Is there another way of disabling length normalization/document boosts to get rid of those files? Why not raise the limit of open files

Re: Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-30 Thread pbm-rico
Thanks for you reply. We are still using Lucene v1.4.3 and I'm not sure if upgrading is an option. Is there another way of disabling length normalization/document boosts to get rid of those files? Thanks, Rico : >From what I read in the Lucene docs, these .f files store the : normalization fac

Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-27 Thread Doron Cohen
Just in case norms info cannot be spared, note that since Lucene 2.1 norms are maintained in a single file, no matter how many fields there are. However due to a bug in 2.1 this did not prevent the too many open files problem. This bug was already fixed but not yet released. For more details on th

Re: How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-27 Thread Chris Hostetter
: >From what I read in the Lucene docs, these .f files store the : normalization factor for the corresponding field. What exactly is this : used for and more importantly, can this be disabled so that the files : are not created in the first place? field norms are primarily used for length normali

How to index a lot of fields (without FileNotFoundException: Too many open files)

2007-04-27 Thread pbm-rico
Hello, What would be the best strategy to support an index with thousands or even hundreds of thousands of individual field names? I have client applications that create a lot of key/value type data. I use the key as document field name so I end up with _a lot_ of .f files and eventually the my