Re: Too many open files when doing performance testing

Use that compound index format and use a single IndexSearcher instance. Otis --- Akhil Jain <[EMAIL PROTECTED]> wrote: > > > > > > Actually, we might not be able to change the setting as we are using > a > shared server and are not allowed to change system settings. What > other > things

Re: Too many open files when doing performance testing

Actually, we might not be able to change the setting as we are using a shared server and are not allowed to change system settings. What other things can we look at to get this fixed? Akhil Jain Otis Gospodnetic <[EMAIL PROTECTED]> Otis Gospodnetic <[EMAIL PROTECTED]> 09/01/2005 09

RE: null results

hi all, even i am getting similar error. i found that it is because of unsorted index..anybody has idea about it? Thanks in advance Regards Nitin -Original Message- From: Gasi [mailto:[EMAIL PROTECTED] Sent: Friday, September 02, 2005 2:45 AM To: java-user@lucene.apache.org Subject: nul

Re: Too many open files when doing performance testing

Hi, 2000 doesn't sound very high. I've used much higher values. Because you have so many fields and files, you may want to increase it. If you have Lucene in Action, we have a formula in there for calculating the number of open files used (section 2.7, according to http://www.lucenebook.com/sea

Re: Too many open files when doing performance testing

Thanks Chris. We are looking at it and have tried few of those things. Will let you know once we have tried all of them. Thanks again. -- Sent from the Lucene - Java Users forum at Nabble.com: http://www.nabble.com/Too-many-open-files-when-doing-performance-testing-t272369.html#a766965

Re: Too many open files when doing performance testing

Thanks Otis for your questions. Here are the answers... Please let me know your thoughts We do optimize() after indexWrite. The maximum open file allowed is 2,000. Is this normal, too small? What is your recommended number ? We have 57 index files, how many files that Lucene index will a

Re: Too many open files when doing performance testing

This is discussed extensively in the FAQ... Why am I getting an IOException that says "Too many open files"? http://wiki.apache.org/jakarta-lucene/LuceneFAQ#head-48921635adf2c968f7936dc07d51dfb40d638b82 : Date: Thu, 1 Sep 2005 19:30:40 -0700 (PDT) : From: "jaina (sent by Nabble.com)" <[

Re: Too many open files when doing performance testing

How many files are in the index directory? If your index is not optimized, try optimizing it first? What's the max number of open files (ulimit -a)? If it looks low, increase it. It looks like you have 20+ fields. How many fields have you got? (just curious) It looks like you are not using the co

Too many open files when doing performance testing

Hi, We are running into performace problem as we use lucene. Everything worked fine till yesterday and today when we starte performance testing we saw an error. Here are the details of the error 54eda4e1 SystemErr R From Faceted SearchImpl rlinksIndexReader.open(dir) failed [9/1/05 17

Re: IO bandwidth throttling

Rajesh Munavalli wrote: > Try this: (CFQ) I/O scheduler > http://lwn.net/Articles/57732/ > > Rajesh Munavalli > The CFQ scheduler is the default in Red Hat Enterprise 4 and recent Fedoras (3 and 4 IIRC). My FC4 system is usable even with processes like 'updatedb' running. http://www.redhat.com

Re: Ideal Index Fragmentation

On Aug 30, 2005, at 9:53 PM, Friedland, Zachary (EDS - Strategy) wrote: > > * I'm interested in implementing a "dynamic filter" component > > that will walk through the hits[] object and pull out distinct > > values for certain fields to display as search-within-a-search > > options (all of them w

null results

Hallo everybody, I am beginning with Lucene. I tested the Webdemo described in the Book on my HomePC. When I upload it on a webserver, this example works but he doesn't find any keyword, the result of every search is null results. I have uploaded the same index consists of 3files deleta

Re: IO bandwidth throttling

Ben Gollmer wrote: >Chris Lamprecht wrote: > > >>I've wanted something similar, for the same purpose -- to keep lucene >>from consuming disk I/O resources when another process is running on >>the same machine. >> >> > >Sorry for jumping in (I'm a Lucene newb) but isn't this better handled >

Re: IO bandwidth throttling

Chris Lamprecht wrote: > I've wanted something similar, for the same purpose -- to keep lucene > from consuming disk I/O resources when another process is running on > the same machine. Sorry for jumping in (I'm a Lucene newb) but isn't this better handled by the OS? On a Unix box I would just ren

RE: IO bandwidth throttling

Try this: (CFQ) I/O scheduler http://lwn.net/Articles/57732/ Rajesh Munavalli > -Original Message- > From: Chris Lamprecht [mailto:[EMAIL PROTECTED] > Sent: Thursday, September 01, 2005 4:00 PM > To: java-user@lucene.apache.org > Subject: Re: IO bandwidth throttling > > Hi Ben, > > Ye

Re: IO bandwidth throttling

Hi Ben, Yes -- I would prefer to let the OS handle his, especially if it can save me some coding. Is there is a way (under linux) to limit a certain process's disk utilization? It seems like nice(1) just modifies the scheduling priority, I'm assuming this means CPU scheduling. In my case, I'm t

Re: Should I use span query?

If I do a proximity search "terma termb"~10 that will get me the documents that have terma within 10 words of termb. But how can I get all the terms > that are within x number of > terms of given query terms. instead of just the documents. Thanks, Andrew -Original Message- From:

Re: Using one physical lucene index for multiple projects

> Multiple users can authenticate to the XML-RPC server but also have > access to different documents inside lucene. > > So I need some information in the lucene index to know which ones the > users is able to access. Currently I generate a MD5 hash of the > username/password and store this as Fie

Re: Using one physical lucene index for multiple projects

Maik Schreiber wrote: Currently, I also store the SecretKey (hash of it) in the index so I know when e.g. the request comes to delete all documents I also which ones. I'm not sure if you're talking about authentication for using the XML-RPC interface here...? Multiple users can authenticate t

RE: Can't return Hits!

Keep the IndexSearcher object you used to get the Hits open until you have finished with them... Luc -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: donderdag 1 september 2005 10:14 To: java-user@lucene.apache.org Subject: Can't return Hits! Hi, i want to r

Re: Using one physical lucene index for multiple projects

> Is any of the authentication incredentials actually put into the index > for this verifyication? No. We're using authentication only to protect the HTTP interface, but you can search for about anything once you're past that. > Currently, I also store the SecretKey (hash of it) in the index so I

Re: Using one physical lucene index for multiple projects

Maik Schreiber wrote: I'm running XML-RPC to allow access to the index. My idea was that I share a SecretKey between the projects indexers and projects clients. So the indexer can only add/remove documents with his key and the client can only access documents with his key. In our projects w

Can't return Hits!

Hi, i want to return the Hits!! For listing them out! But i get this Exception! Exception in thread "main" java.io.IOException: Das Handle ist ungültig at java.io.RandomAccessFile.seek(Native Method) at org.apache.lucene.store.FSInputStream.readInternal(FSDirectory.java:415)