Re:Re:Re: IO probleam in forceMerge(1)

2015-08-21 Thread dr
I used to say "when i did some copy operation on the machine the speed may become normal.", it seems not correct. But when forceMerge hangs on IO, if i use the command "echo 3 > /proc/sys/vm/drop_caches", the io become normal again. At 2015-08-21 11:59:30, "dr" wrote: > >Also i noticed that i

Re:Re: IO probleam in forceMerge(1)

2015-08-20 Thread dr
Also i noticed that in the begin the speed was normal, and it slowed down later. The total space of the index is 15GB, and *.fdt takes 12GB. I allocated 8GB memory for forceMerge, is this enough for that? I readed the code and doc, it seems that *.fdt is readed and stored in block of 16KB, i

Re: IO probleam in forceMerge(1)

2015-08-20 Thread Michael McCandless
I would first try upgrading you JVM: 1.7.0_05 is ancient. Mike McCandless http://blog.mikemccandless.com On Thu, Aug 20, 2015 at 7:49 AM, dr wrote: > Hi ,all > Currenty i met a probleam with forceMerge(1). During forceMerging some of > my machine spent too much time(10-20 hours for a inde

IO probleam in forceMerge(1)

2015-08-20 Thread dr
Hi ,all Currenty i met a probleam with forceMerge(1). During forceMerging some of my machine spent too much time(10-20 hours for a index size of 15GB). By using some command like top, iostat, jstack. I found that the avg of cpu, and disk is too low, nearly zero. And the size of the the inde