Hi Joe, PFA heap dump
regards: Rahul Bhardwaj On Tue, Jan 6, 2015 at 11:35 AM, Joe Ramsey <joe.ram...@mac.com> wrote: > Did you try generating a heap dump so you can look through it to see > what’s actually happened? > > > On Jan 6, 2015, at 12:58 AM, Rahul Bhardwaj <rahul.bhard...@indiamart.com> > wrote: > > Hi, > > We are using cassandra 2.1 version in a cluster of three machines each > with 64 GB RAM > > The processes are killed by kernel, coz they are eating all memory > (oom-killer). We have set JAVA heap to default (i.e. it is using 8G) > because we have 64 GB RAM. > > Please help. > > > Regards: > Rahul Bhardwaj > > > Follow IndiaMART.com <http://www.indiamart.com/> for latest updates on > this and more: <https://plus.google.com/+indiamart> > <https://www.facebook.com/IndiaMART> <https://twitter.com/IndiaMART> > Mobile Channel: > <https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=668561641&mt=8> > <https://play.google.com/store/apps/details?id=com.indiamart.m> > <http://m.indiamart.com/> > > <https://www.youtube.com/watch?v=DzORNbeSXN8&list=PL2o4J51MqpL0mbue6kzDa6eymLVUXtlR1&index=2> > Watch how Irrfan Khan gets his work done in no time on IndiaMART, kyunki Kaam > Yahin Banta Hai <https://www.youtube.com/watch?v=hmS4Afl2bNU>!!! > > > -- Follow IndiaMART.com <http://www.indiamart.com> for latest updates on this and more: <https://plus.google.com/+indiamart> <https://www.facebook.com/IndiaMART> <https://twitter.com/IndiaMART> Mobile Channel: <https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=668561641&mt=8> <https://play.google.com/store/apps/details?id=com.indiamart.m> <http://m.indiamart.com/> <https://www.youtube.com/watch?v=DzORNbeSXN8&list=PL2o4J51MqpL0mbue6kzDa6eymLVUXtlR1&index=2> Watch how Irrfan Khan gets his work done in no time on IndiaMART, kyunki Kaam Yahin Banta Hai <https://www.youtube.com/watch?v=hmS4Afl2bNU>!!!
Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:03:06.106+0530: 9095.105: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 5760 bytes, 5760 total : 159243K->28984K(1887488K), 0.0160950 secs] 1913769K->1801291K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 327077310 Max Chunk Size: 177644103 Number of Blocks: 1672 Av. Block Size: 195620 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0165220 secs] [Times: user=0.21 sys=0.00, real=0.02 secs] Heap after GC invocations=1666 (full 4): par new generation total 1887488K, used 28984K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 13% used [0x0000000661480000, 0x00000006630ce348, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1772306K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:03:06.122+0530: 9095.122: Total time for which application threads were stopped: 0.0174150 seconds 2015-01-06T12:03:14.769+0530: 9103.768: Total time for which application threads were stopped: 0.0033370 seconds {Heap before GC invocations=1666 (full 4): par new generation total 1887488K, used 1706823K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 13% used [0x0000000661480000, 0x00000006630d1ec0, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1772306K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:03:14.770+0530: 9103.769: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 327077310 Max Chunk Size: 177644103 Number of Blocks: 1672 Av. Block Size: 195620 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:03:14.770+0530: 9103.769: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 10832160 bytes, 10832160 total : 1706823K->18310K(1887488K), 0.0152120 secs] 3479130K->1790618K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 327077310 Max Chunk Size: 177644103 Number of Blocks: 1672 Av. Block Size: 195620 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0160070 secs] [Times: user=0.24 sys=0.00, real=0.01 secs] Heap after GC invocations=1667 (full 4): par new generation total 1887488K, used 18310K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 8% used [0x000000066e140000, 0x000000066f321ac0, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1772308K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:03:14.786+0530: 9103.785: Total time for which application threads were stopped: 0.0167600 seconds {Heap before GC invocations=1667 (full 4): par new generation total 1887488K, used 32050K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fbb6ad68, 0x0000000661480000) from space 209664K, 8% used [0x000000066e140000, 0x000000066f321ac0, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1772308K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:03:14.786+0530: 9103.785: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 327077310 Max Chunk Size: 177644103 Number of Blocks: 1672 Av. Block Size: 195620 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:03:14.786+0530: 9103.786: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 2448 bytes, 2448 total : 32050K->2225K(1887488K), 0.0128040 secs] 1804358K->1785116K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325911147 Max Chunk Size: 177644103 Number of Blocks: 1638 Av. Block Size: 198968 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0131880 secs] [Times: user=0.20 sys=0.00, real=0.02 secs] Heap after GC invocations=1668 (full 4): par new generation total 1887488K, used 2225K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 1% used [0x0000000661480000, 0x00000006616ac568, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1782890K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:03:14.800+0530: 9103.799: Total time for which application threads were stopped: 0.0137170 seconds {Heap before GC invocations=1668 (full 4): par new generation total 1887488K, used 1680049K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 1% used [0x0000000661480000, 0x00000006616ac568, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1782890K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:03:28.054+0530: 9117.053: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325911147 Max Chunk Size: 177644103 Number of Blocks: 1638 Av. Block Size: 198968 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:03:28.054+0530: 9117.054: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 132031856 bytes, 132031856 total : 1680049K->129369K(1887488K), 0.0501720 secs] 3462940K->1912260K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325911147 Max Chunk Size: 177644103 Number of Blocks: 1638 Av. Block Size: 198968 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0508790 secs] [Times: user=0.83 sys=0.00, real=0.05 secs] Heap after GC invocations=1669 (full 4): par new generation total 1887488K, used 129369K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 61% used [0x000000066e140000, 0x0000000675f96500, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1782890K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:03:28.105+0530: 9117.104: Total time for which application threads were stopped: 0.0516320 seconds 2015-01-06T12:04:02.003+0530: 9151.002: Total time for which application threads were stopped: 0.0005460 seconds 2015-01-06T12:04:02.050+0530: 9151.049: Total time for which application threads were stopped: 0.0003890 seconds {Heap before GC invocations=1669 (full 4): par new generation total 1887488K, used 1807193K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 61% used [0x000000066e140000, 0x0000000675f96500, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1782890K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:04:02.998+0530: 9151.997: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325911147 Max Chunk Size: 177644103 Number of Blocks: 1638 Av. Block Size: 198968 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:04:02.999+0530: 9151.998: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 75228552 bytes, 75228552 total : 1807193K->126436K(1887488K), 0.0545010 secs] 3590084K->1942253K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325244621 Max Chunk Size: 177644103 Number of Blocks: 1623 Av. Block Size: 200397 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0552200 secs] [Times: user=0.68 sys=0.00, real=0.05 secs] Heap after GC invocations=1670 (full 4): par new generation total 1887488K, used 126436K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 60% used [0x0000000661480000, 0x0000000668ff9138, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1815817K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:04:03.054+0530: 9152.053: Total time for which application threads were stopped: 0.0560190 seconds {Heap before GC invocations=1670 (full 4): par new generation total 1887488K, used 1804260K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 60% used [0x0000000661480000, 0x0000000668ff9138, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1815817K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:04:14.142+0530: 9163.141: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 325244621 Max Chunk Size: 177644103 Number of Blocks: 1623 Av. Block Size: 200397 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:04:14.142+0530: 9163.141: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 6337944 bytes, 6337944 total : 1804260K->43952K(1887488K), 0.0531660 secs] 3620077K->1928034K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 321458263 Max Chunk Size: 177644103 Number of Blocks: 1585 Av. Block Size: 202812 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0538220 secs] [Times: user=0.59 sys=0.00, real=0.05 secs] Heap after GC invocations=1671 (full 4): par new generation total 1887488K, used 43952K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 20% used [0x000000066e140000, 0x0000000670c2c158, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1884081K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:04:14.196+0530: 9163.195: Total time for which application threads were stopped: 0.0546560 seconds 2015-01-06T12:04:23.715+0530: 9172.714: Total time for which application threads were stopped: 0.0005240 seconds 2015-01-06T12:04:39.371+0530: 9188.370: Total time for which application threads were stopped: 0.0018750 seconds 2015-01-06T12:04:41.602+0530: 9190.601: Total time for which application threads were stopped: 0.0005320 seconds {Heap before GC invocations=1671 (full 4): par new generation total 1887488K, used 1721785K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 20% used [0x000000066e140000, 0x0000000670c2e728, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1884081K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:04:41.602+0530: 9190.602: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 321458263 Max Chunk Size: 177644103 Number of Blocks: 1585 Av. Block Size: 202812 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:04:41.603+0530: 9190.602: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 63020520 bytes, 63020520 total : 1721785K->66999K(1887488K), 0.0415260 secs] 3605867K->1952693K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 321408824 Max Chunk Size: 177644103 Number of Blocks: 1584 Av. Block Size: 202909 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0422800 secs] [Times: user=0.67 sys=0.00, real=0.04 secs] Heap after GC invocations=1672 (full 4): par new generation total 1887488K, used 66999K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 31% used [0x0000000661480000, 0x00000006655eded8, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1885693K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:04:41.645+0530: 9190.644: Total time for which application threads were stopped: 0.0430150 seconds 2015-01-06T12:05:06.036+0530: 9215.035: Total time for which application threads were stopped: 0.0006520 seconds {Heap before GC invocations=1672 (full 4): par new generation total 1887488K, used 1744823K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 31% used [0x0000000661480000, 0x00000006655edf90, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1885693K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:05:06.037+0530: 9215.036: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 321408824 Max Chunk Size: 177644103 Number of Blocks: 1584 Av. Block Size: 202909 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:05:06.037+0530: 9215.036: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 21801304 bytes, 21801304 total : 1744823K->56244K(1887488K), 0.0630280 secs] 3630517K->2000713K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 320250517 Max Chunk Size: 177644103 Number of Blocks: 1565 Av. Block Size: 204632 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0636320 secs] [Times: user=0.76 sys=0.01, real=0.06 secs] Heap after GC invocations=1673 (full 4): par new generation total 1887488K, used 56244K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 26% used [0x000000066e140000, 0x000000067182d3c0, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1944468K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29755K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:05:06.100+0530: 9215.099: Total time for which application threads were stopped: 0.0641160 seconds {Heap before GC invocations=1673 (full 4): par new generation total 1887488K, used 1734068K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 26% used [0x000000066e140000, 0x000000067182d3c0, 0x000000067ae00000) to space 209664K, 0% used [0x0000000661480000, 0x0000000661480000, 0x000000066e140000) concurrent mark-sweep generation total 6291456K, used 1944468K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29761K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:05:21.002+0530: 9230.001: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 320250517 Max Chunk Size: 177644103 Number of Blocks: 1565 Av. Block Size: 204632 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:05:21.003+0530: 9230.002: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 11336624 bytes, 11336624 total : 1734068K->22921K(1887488K), 0.0216940 secs] 3678537K->1974673K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 319771329 Max Chunk Size: 177644103 Number of Blocks: 1551 Av. Block Size: 206171 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0222930 secs] [Times: user=0.33 sys=0.00, real=0.02 secs] Heap after GC invocations=1674 (full 4): par new generation total 1887488K, used 22921K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 0% used [0x00000005fae00000, 0x00000005fae00000, 0x0000000661480000) from space 209664K, 10% used [0x0000000661480000, 0x0000000662ae2658, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1951752K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29761K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) } 2015-01-06T12:05:21.025+0530: 9230.024: Total time for which application threads were stopped: 0.0234600 seconds 2015-01-06T12:05:23.855+0530: 9232.854: Total time for which application threads were stopped: 0.0005470 seconds 2015-01-06T12:05:26.536+0530: 9235.535: Total time for which application threads were stopped: 0.0006560 seconds {Heap before GC invocations=1674 (full 4): par new generation total 1887488K, used 1700745K [0x00000005fae00000, 0x000000067ae00000, 0x000000067ae00000) eden space 1677824K, 100% used [0x00000005fae00000, 0x0000000661480000, 0x0000000661480000) from space 209664K, 10% used [0x0000000661480000, 0x0000000662ae2658, 0x000000066e140000) to space 209664K, 0% used [0x000000066e140000, 0x000000066e140000, 0x000000067ae00000) concurrent mark-sweep generation total 6291456K, used 1951752K [0x000000067ae00000, 0x00000007fae00000, 0x00000007fae00000) concurrent-mark-sweep perm gen total 49632K, used 29761K [0x00000007fae00000, 0x00000007fde78000, 0x0000000800000000) 2015-01-06T12:05:27.048+0530: 9236.047: [GCBefore GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 319771329 Max Chunk Size: 177644103 Number of Blocks: 1551 Av. Block Size: 206171 Tree Height: 25 Before GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 2015-01-06T12:05:27.048+0530: 9236.047: [ParNew Desired survivor size 107347968 bytes, new threshold 1 (max 1) - age 1: 88909656 bytes, 88909656 total : 1700745K->91517K(1887488K), 0.0324080 secs] 3652497K->2048998K(8178944K)After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 319365919 Max Chunk Size: 177644103 Number of Blocks: 1544 Av. Block Size: 206843 Tree Height: 25 After GC: Statistics for BinaryTreeDictionary: ------------------------------------ Total Free Space: 2530728 Max Chunk Size: 2527232 Number of Blocks: 9 Av. Block Size: 281192 Tree Height: 5 , 0.0331030 secs] [Times: user=0.51 sys=0.00, real=0.03 secs]