Re: readModifiedUTF8String stuck

2009-04-24 Thread Michael McCandless
On Fri, Apr 24, 2009 at 4:46 PM, MakMak wrote: > > - We had a 2.3.2 index earlier. We have reindexed using 2.4.1 now. So the hang still happens with 2.4.1? > - SAN is ruled out. This occurs even with local file system. OK. Have you confirmed things are really hung, vs just taking a long time?

Re: readModifiedUTF8String stuck

2009-04-24 Thread MakMak
- We had a 2.3.2 index earlier. We have reindexed using 2.4.1 now. - SAN is ruled out. This occurs even with local file system. - One more point, this occurs with very high load on the application. about 2-3 requests per second, the search part of each request is within milliseconds. the page size

Re: readModifiedUTF8String stuck

2009-04-24 Thread Michael McCandless
On Tue, Apr 21, 2009 at 6:25 PM, MakMak wrote: >   Ran CheckIndex. This is what it prints out: > > cantOpenSegments: false > numBadSegments: 0 > numSegments: 14 > segmentFormat: FORMAT_HAS_PROX [Lucene 2.4] > segmentsFileName: segments_2od > totLoseDocCount: 0 > clean: true > toolOutOfDate: false

Re: readModifiedUTF8String stuck

2009-04-21 Thread MakMak
Mike, Ran CheckIndex. This is what it prints out: cantOpenSegments: false numBadSegments: 0 numSegments: 14 segmentFormat: FORMAT_HAS_PROX [Lucene 2.4] segmentsFileName: segments_2od totLoseDocCount: 0 clean: true toolOutOfDate: false So I guess everything is fine ..! Our application is

Re: readModifiedUTF8String stuck

2009-04-21 Thread Michael McCandless
On Mon, Apr 20, 2009 at 6:07 PM, MakMak wrote: >   I made a standalone tool like you suggested which prints out the size of > each doc in the index, none of the docs are more than 1MB !!! The queries > are the same. They repeat throughout the test. We give about 6GB of heap to > the application a

Re: readModifiedUTF8String stuck

2009-04-20 Thread MakMak
Mike, I made a standalone tool like you suggested which prints out the size of each doc in the index, none of the docs are more than 1MB !!! The queries are the same. They repeat throughout the test. We give about 6GB of heap to the application and yes we are on 64 bit JVM. I hit upon anothe

Re: readModifiedUTF8String stuck

2009-04-17 Thread Michael McCandless
On Fri, Apr 17, 2009 at 5:05 AM, MakMak wrote: > I am not retrieving many docs, the problem is that the whole file is stored > in the doc. I need the file content for highlighter to work. But the files > are normal-sized text files which in any case should not exceed 10-15mb. > Retrieving 25 of t

Re: readModifiedUTF8String stuck

2009-04-17 Thread MakMak
I am not retrieving many docs, the problem is that the whole file is stored in the doc. I need the file content for highlighter to work. But the files are normal-sized text files which in any case should not exceed 10-15mb. Retrieving 25 of them(page size), worst case scenario will take 250mb of

Re: readModifiedUTF8String stuck

2009-04-17 Thread Michael McCandless
Can you describe your app a bit? How many documents are you retrieving for each search? It seems like Weblogic noticed a single HTTP request took more than 600 seconds and then dumped out all stack traces? In which case, maybe the threads were not actually "stuck", but were doing something that

Re: readModifiedUTF8String stuck

2009-04-17 Thread MakMak
Please do not mind these more traces: -- ExecuteThread: '30' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "647" seconds working on the request "Http Request: /search_results.jsp