I am not retrieving many docs, the problem is that the whole file is stored in the doc. I need the file content for highlighter to work. But the files are normal-sized text files which in any case should not exceed 10-15mb. Retrieving 25 of them(page size), worst case scenario will take 250mb of data transfer which should not take more than 600 secs.
This may not be easily reproduced, but is easy to describe, we bombard our application with about 3-4 requests per second for 2 hours as a part of stress tests. Previously when we were on 2.3.2, these used to run just fine. We had to upgrade due to a memory leak issue for which CloseableThreadLocal was implemented in 2.4.1. The testing team did not reindex with the new lucene version, but they dont have to, right? thats when they saw these stuck threads. The tests ran fine for an hour when responses were being returned timely. But after an hour, the threads just started to accumulate. I am not sure amount of RAM consumed during searches, will find that out. Hope I have been clear, do you smell something fishy in this? -thanks Michael McCandless-2 wrote: > > Can you describe your app a bit? How many documents are you > retrieving for each search? > > It seems like Weblogic noticed a single HTTP request took more than > 600 seconds and then dumped out all stack traces? In which case, > maybe the threads were not actually "stuck", but were doing something > that was taking far too long, and so you caught the threads at a > certain point in their processing (loading a document). > > Is this easily reproduced? Do certain searches run quickly but others > consistently hit this 600 second timeout? Is the JRE consuming way > too much RAM when this happens? > > Mike > > > -- View this message in context: http://www.nabble.com/readModifiedUTF8String-stuck-tp23089805p23093956.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
