Martin, Please create a ticket and include the relevant parts of your storage-conf.
To summarize, the output gives you the impression that bootstrap has completed normally, but when you check, it appears to be hung on the receiving nodes? Do you mind turning debug on and and seeing if you can reproduce? The strange part is that the source node doesn't think it's streaming at all. Gary. On Mon, May 3, 2010 at 02:30, Dr. Martin Grabmüller <martin.grabmuel...@eleven.de> wrote: > Hello list, > > I encountered a problem with streaming in my test cluster but > found nothing like this in JIRA or on the list. > > I'm running a test cluster of three nodes, RF=3, Cassandra 0.6.1. > I started the first node and inserted some data, then bootstrapped > the other machines one after the other. No problems here. > > Then, I inserted data over the weekend and checked back this morning, > finding a lot of -tmp-files in the data directory of the two bootstrapepd > machines which seem to be leftovers from streaming. > > Interesting thing is, they are mostly all about the same size on each node. > Additionally, > this size is the same as the size of some file to be streamed (see the output > of > nodetool streams at the end of this post): > > [Node 2:] > > -rw-r--r-- 1 cassandra cassandra 2360 2010-05-03 07:39 > AccountList-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 2360 2010-05-03 00:39 > AddressList-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 2360 2010-05-03 07:53 > IndexQueue-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 2360 2010-05-03 05:19 > MailMetadata-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 2360 2010-05-03 00:53 > Statistics-tmp-7-Data.db > > [Node 3:] > > -rw-r--r-- 1 cassandra cassandra 10994 2010-05-03 07:39 > AccountList-tmp-6-Data.db > -rw-r--r-- 1 cassandra cassandra 325 2010-05-03 00:39 > AddressList-tmp-6-Data.db > -rw-r--r-- 1 cassandra cassandra 10994 2010-05-03 08:02 > CustomerList-tmp-6-Data.db > -rw-r--r-- 1 cassandra cassandra 10994 2010-05-03 07:53 > IndexQueue-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 10994 2010-05-03 01:02 > MailMetadata-tmp-7-Data.db > -rw-r--r-- 1 cassandra cassandra 10994 2010-05-03 00:53 > Statistics-tmp-7-Data.db > > Checking the logs, I find a few streaming-related error messages: > > [Node 1 (yes, the node without leftover files):] > > ERROR [MESSAGE-STREAMING-POOL:1] 2010-05-02 14:39:10,675 > DebuggableThreadPoolExecutor.java (line 101) Error in ThreadPoolExecutor > java.lang.RuntimeException: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/LocalpartMapping-2-Data.db (No > such file or directory) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/LocalpartMapping-2-Data.db (No > such file or directory) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233) > at > org.apache.cassandra.net.FileStreamTask.stream(FileStreamTask.java:84) > at > org.apache.cassandra.net.FileStreamTask.runMayThrow(FileStreamTask.java:63) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > ... 3 more > ERROR [MESSAGE-STREAMING-POOL:1] 2010-05-02 14:39:10,675 CassandraDaemon.java > (line 78) Fatal exception in thread Thread[MESSAGE-STREAMING-POOL:1,5,main] > java.lang.RuntimeException: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/LocalpartMapping-2-Data.db (No > such file or directory) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/LocalpartMapping-2-Data.db (No > such file or directory) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233) > at > org.apache.cassandra.net.FileStreamTask.stream(FileStreamTask.java:84) > at > org.apache.cassandra.net.FileStreamTask.runMayThrow(FileStreamTask.java:63) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > ... 3 more > > [Node 3:] > > ERROR [MESSAGE-STREAMING-POOL:1] 2010-05-03 00:39:46,656 > DebuggableThreadPoolExecutor.java (line 101) Error in ThreadPoolExecutor > java.lang.RuntimeException: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/Headers-7-Data.db (No such file or > directory) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/Headers-7-Data.db (No such file or > directory) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233) > at > org.apache.cassandra.net.FileStreamTask.stream(FileStreamTask.java:84) > at > org.apache.cassandra.net.FileStreamTask.runMayThrow(FileStreamTask.java:63) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > ... 3 more > ERROR [MESSAGE-STREAMING-POOL:1] 2010-05-03 00:39:46,656 CassandraDaemon.java > (line 78) Fatal exception in thread Thread[MESSAGE-STREAMING-POOL:1,5,main] > java.lang.RuntimeException: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/Headers-7-Data.db (No such file or > directory) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.FileNotFoundException: > /mnt/data000/cassandra/data/Archive/stream/Headers-7-Data.db (No such file or > directory) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233) > at > org.apache.cassandra.net.FileStreamTask.stream(FileStreamTask.java:84) > at > org.apache.cassandra.net.FileStreamTask.runMayThrow(FileStreamTask.java:63) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > ... 3 more > > On Node 2, there are no errors. > > I have not been able to reproduce this error with the default configuration. > > Has anybody an idea how to debug this problem? Is this known? Should I > create > a ticket? > > Thanks in advance! > > Martin > > P.S. Here is the output of nodetool streams for the three nodes: > > [Node 1:] 192.168.211.44 > > Mode: Normal > Nothing streaming to /192.168.211.46 > Nothing streaming to /192.168.211.45 > Not receiving any streams. > > [Node 2:] 192.168.211.45 > > Mode: Normal > Streaming to: /192.168.211.46 > /mnt/data000/cassandra/data/Archive/stream/AddressList-6-Data.db 10994/10994 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Index.db 0/3142 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Data.db 0/15974 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Index.db 0/758284 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Filter.db 0/16525 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Data.db 0/5581529 > /mnt/data000/cassandra/data/Archive/stream/AccountList-6-Index.db 0/592 > /mnt/data000/cassandra/data/Archive/stream/AccountList-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AccountList-6-Data.db 0/2866 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Index.db 0/648 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Data.db 0/8801484 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-6-Index.db 0/61 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-6-Data.db 0/229 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Index.db 0/12171 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Filter.db 0/445 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Data.db 0/9148876 > /mnt/data000/cassandra/data/Archive/stream/MailList-88-Index.db 0/59273 > /mnt/data000/cassandra/data/Archive/stream/MailList-88-Filter.db 0/36685 > /mnt/data000/cassandra/data/Archive/stream/MailList-88-Data.db 0/109059024 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Index.db 0/632998 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Filter.db 0/24685 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Data.db 0/5148176 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Index.db 0/2360 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Data.db 0/10994 > /mnt/data000/cassandra/data/Archive/stream/Statistics-12-Index.db 0/3142 > /mnt/data000/cassandra/data/Archive/stream/Statistics-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/Statistics-12-Data.db 0/15996 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Index.db 0/789717 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Filter.db 0/29005 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Data.db 0/5791834 > /mnt/data000/cassandra/data/Archive/stream/AccountList-12-Index.db 0/592 > /mnt/data000/cassandra/data/Archive/stream/AccountList-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AccountList-12-Data.db 0/2866 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Index.db 0/648 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Data.db 0/5280403 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-12-Index.db 0/61 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-12-Data.db 0/229 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Index.db 0/12171 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Filter.db 0/445 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Data.db 0/14228834 > Nothing streaming to /192.168.211.44 > Streaming from: /192.168.211.46 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-7-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-7-Data.db > 0/229 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Index.db 0/12171 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Filter.db 0/445 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Data.db > 0/9050963 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-87-Index.db > 0/58383 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-87-Filter.db > 0/36685 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-87-Data.db > 0/107327613 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Index.db > 0/646210 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Filter.db > 0/24925 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Data.db > 0/5254628 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Index.db > 0/2360 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Data.db > 0/10994 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-13-Index.db > 0/3142 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-13-Data.db > 0/15995 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Index.db > 0/802581 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Filter.db > 0/29125 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Data.db > 0/5885615 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-13-Index.db > 0/592 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-13-Data.db > 0/2866 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Index.db > 0/648 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Data.db > 0/5310585 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-13-Index.db > 0/61 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-13-Data.db > 0/229 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Index.db > 0/12171 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Filter.db 0/445 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Data.db > 0/14129376 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-7-Index.db > 2360/3142 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Data.db > 2360/5673882 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-7-Data.db > 2360/2866 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Filter.db > 2360/16645 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-7-Data.db > 2360/8830815 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-7-Data.db > 2360/10994 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-7-Data.db > 2360/15971 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Index.db > 2360/770984 > > [Node 3:] 192.168.211.46 > > Mode: Normal > Nothing streaming to /192.168.211.44 > Streaming to: /192.168.211.45 > /mnt/data000/cassandra/data/Archive/stream/AddressList-7-Index.db 2360/2360 > /mnt/data000/cassandra/data/Archive/stream/AddressList-7-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AddressList-7-Data.db 0/10994 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Index.db 0/3142 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/Statistics-6-Data.db 0/15971 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Index.db 0/770984 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Filter.db 0/16645 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-6-Data.db 0/5673882 > /mnt/data000/cassandra/data/Archive/stream/AccountList-7-Index.db 0/592 > /mnt/data000/cassandra/data/Archive/stream/AccountList-7-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AccountList-7-Data.db 0/2866 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Index.db 0/648 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-6-Data.db 0/8830815 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-7-Index.db 0/61 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-7-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-7-Data.db 0/229 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Index.db 0/12171 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Filter.db 0/445 > /mnt/data000/cassandra/data/Archive/stream/EventLog-6-Data.db 0/9050963 > /mnt/data000/cassandra/data/Archive/stream/MailList-86-Index.db 0/58383 > /mnt/data000/cassandra/data/Archive/stream/MailList-86-Filter.db 0/36685 > /mnt/data000/cassandra/data/Archive/stream/MailList-86-Data.db 0/107327613 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Index.db 0/646210 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Filter.db 0/24925 > /mnt/data000/cassandra/data/Archive/stream/Headers-11-Data.db 0/5254628 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Index.db 0/2360 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AddressList-12-Data.db 0/10994 > /mnt/data000/cassandra/data/Archive/stream/Statistics-13-Index.db 0/3142 > /mnt/data000/cassandra/data/Archive/stream/Statistics-13-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/Statistics-13-Data.db 0/15995 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Index.db 0/802581 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Filter.db 0/29125 > /mnt/data000/cassandra/data/Archive/stream/MailMetadata-12-Data.db 0/5885615 > /mnt/data000/cassandra/data/Archive/stream/AccountList-13-Index.db 0/592 > /mnt/data000/cassandra/data/Archive/stream/AccountList-13-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/AccountList-13-Data.db 0/2866 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Index.db 0/648 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/IndexQueue-12-Data.db 0/5310585 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-13-Index.db 0/61 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-13-Filter.db 0/325 > /mnt/data000/cassandra/data/Archive/stream/CustomerList-13-Data.db 0/229 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Index.db 0/12171 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Filter.db 0/445 > /mnt/data000/cassandra/data/Archive/stream/EventLog-12-Data.db 0/14129376 > Streaming from: /192.168.211.45 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Index.db 0/12171 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Filter.db 0/445 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-7-Data.db > 0/9148876 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-88-Index.db > 0/59273 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-88-Filter.db > 0/36685 > Archive: /mnt/data000/cassandra/data/Archive/MailList-tmp-88-Data.db > 0/109059024 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Index.db > 0/632998 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Filter.db > 0/24685 > Archive: /mnt/data000/cassandra/data/Archive/Headers-tmp-12-Data.db > 0/5148176 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Index.db > 0/2360 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-13-Data.db > 0/10994 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-12-Index.db > 0/3142 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-12-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-12-Data.db > 0/15996 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Index.db > 0/789717 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Filter.db > 0/29005 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-13-Data.db > 0/5791834 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-12-Index.db > 0/592 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-12-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/AccountList-tmp-12-Data.db > 0/2866 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Index.db > 0/648 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-13-Data.db > 0/5280403 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-12-Index.db > 0/61 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-12-Filter.db > 0/325 > Archive: /mnt/data000/cassandra/data/Archive/CustomerList-tmp-12-Data.db > 0/229 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Index.db > 0/12171 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Filter.db 0/445 > Archive: /mnt/data000/cassandra/data/Archive/EventLog-tmp-13-Data.db > 0/14228834 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Index.db > 10994/758284 > Archive: /mnt/data000/cassandra/data/Archive/AddressList-tmp-6-Data.db > 325/10994 > Archive: /mnt/data000/cassandra/data/Archive/IndexQueue-tmp-7-Data.db > 10994/8801484 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Data.db > 10994/5581529 > Archive: /mnt/data000/cassandra/data/Archive/MailMetadata-tmp-7-Filter.db > 10994/16525 > Archive: /mnt/data000/cassandra/data/Archive/Statistics-tmp-7-Data.db > 10994/15974 >
