Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-23 Thread Aaron Morton
mmm, my bad there. First schema changes are always flushed to disk, so the commit log is not really an issue. Second when the commit log replays it just processes the mutations, the "Drop keyspace” message comes from MigrationManager.announceKeyspaceDrop() and is not called. If you can rep

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-08 Thread Aaron Morton
Do you have the logs from after the restart ? Did it include a "Drop Keyspace…” INFO level message ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 2:44 am, Desimpel, I

Re: commitlog replay extremely slow?

2011-10-18 Thread Yang
jstack shows that all the mutation stages are blocked on a synchronization: "MutationStage:1" prio=10 tid=0x2aaabc01b000 nid=0x27b8 waiting for monitor entry [0x42048000] java.lang.Thread.State: BLOCKED (on object monitor) at org.apache.cassandra.db.Table.apply(Table.java:4

Re: commitlog replay missing data

2011-07-13 Thread Peter Schuller
> # wait for a bit until no one is sending it writes anymore More accurately, until all other nodes have realized it's down (nodetool ring on each respective host). -- / Peter Schuller (@scode on twitter)

Re: commitlog replay missing data

2011-07-13 Thread Peter Schuller
> What are the other ways to stop Cassandra? nodetool disablegossip nodetool disablethrift # wait for a bit until no one is sending it writes anymore nodetool flush # only relevant if in periodic mode # then kill it > What's the difference between batch vs periodic? Search for "batch" on http://

Re: commitlog replay missing data

2011-07-13 Thread mcasandra
Peter Schuller wrote: > >> Recently upgraded to 0.8.1 and noticed what seems to be missing data >> after a >> commitlog replay on a single-node cluster. I start the node, insert a >> bunch >> of stuff (~600MB), stop it, and restart it. There are log messages > > If you stop by a kill, make sure

Re: commitlog replay missing data

2011-07-13 Thread Peter Schuller
> Recently upgraded to 0.8.1 and noticed what seems to be missing data after a > commitlog replay on a single-node cluster. I start the node, insert a bunch > of stuff (~600MB), stop it, and restart it. There are log messages If you stop by a kill, make sure you use batched commitlog synch mode in

Re: commitlog replay missing data

2011-07-13 Thread Aaron Morton
Have you verified that data you expect to see is not in the server after shutdown? WRT the differed in the difference between the Memtable data size and SSTable live size, don't believe everything you read :) Memtable live size is increased by the serialised byte size of every column inserted,

Re: CommitLog replay

2011-06-21 Thread aaron morton
how long the default flush expiry period is? > > Cheers, > Steve > > -Original Message- > From: sc...@scode.org [mailto:sc...@scode.org] On Behalf Of Peter Schuller > Sent: Tuesday, June 21, 2011 9:13 AM > To: user@cassandra.apache.org > Subject: Re: CommitLog replay &

RE: CommitLog replay

2011-06-21 Thread Stephen Pope
nd how long the default flush expiry period is? Cheers, Steve -Original Message- From: sc...@scode.org [mailto:sc...@scode.org] On Behalf Of Peter Schuller Sent: Tuesday, June 21, 2011 9:13 AM To: user@cassandra.apache.org Subject: Re: CommitLog replay > I’ve got a single node deploy

Re: CommitLog replay

2011-06-21 Thread Peter Schuller
> I’ve got a single node deployment of 0.8 set up on my windows box. When I > insert a bunch of data into it, the commitlogs directory doesn’t clear upon > completion (should it?). It is expected that commit logs are retained for a while, and that there is reply going on when restarting a node. Th