Re: slow search threads during a disk copy

2010-08-24 Thread Toke Eskildsen
On Mon, 2010-08-23 at 11:43 +0200, gag...@graffiti.net wrote: > Intererstingly, the copy is quite fast (around 30s) when there are no > searches in progress. I agree with Anshum: This looks very much like IO contention. However, it might not just be a case of seek-time trouble: We've had similar

Re: slow search threads during a disk copy

2010-08-23 Thread Anshum
gt; To: java-user@lucene.apache.org > Sent: Mon, Aug 23, 2010 2:10 pm > Subject: Re: slow search threads during a disk copy > > > Well, there still sounds like plenty of scope for IO contention. Are > source and dest directories on the same disk? What does iostat show? > Co

Re: slow search threads during a disk copy

2010-08-23 Thread gaganb
Gagan -Original Message- From: Ian Lea To: java-user@lucene.apache.org Sent: Mon, Aug 23, 2010 2:10 pm Subject: Re: slow search threads during a disk copy Well, there still sounds like plenty of scope for IO contention. Are source and dest directories on the same disk? What does iostat show?

Re: slow search threads during a disk copy

2010-08-23 Thread Ian Lea
gan > > > > > > -Original Message- > From: Anshum > To: java-user@lucene.apache.org > Sent: Mon, Aug 23, 2010 1:17 pm > Subject: Re: slow search threads during a disk copy > > > Seems like a case of I/O issues. You may be reading content off th

Re: slow search threads during a disk copy

2010-08-23 Thread gaganb
al Message- From: Anshum To: java-user@lucene.apache.org Sent: Mon, Aug 23, 2010 1:17 pm Subject: Re: slow search threads during a disk copy Seems like a case of I/O issues. You may be reading content off the index while performing searches while the I/O for copy is also happening. -- Anshum

Re: slow search threads during a disk copy

2010-08-23 Thread Anshum
Seems like a case of I/O issues. You may be reading content off the index while performing searches while the I/O for copy is also happening. -- Anshum Gupta http://ai-cafe.blogspot.com On Mon, Aug 23, 2010 at 1:12 PM, wrote: > > Hi all, > > > We're observing search threads slowing down during

slow search threads during a disk copy

2010-08-23 Thread gaganb
Hi all, We're observing search threads slowing down during directory copies performed during updates to the index. The thread dump shows search threads blocked on a FSDirectory$FSIndexInput$Descriptor instance: "Worker Thread - 12" daemon prio=10 tid=0x082b2400 nid=0x4654 waiting for monit