RE: Compacted_at timestamp

2015-02-08 Thread Andreas Finke
I created a small script recently converting this timestamp into a human readable string and sort all entries ascending. nodetool compactionhistory |awk '{timestamp = strftime("%a %b %e %H:%M:%S %Z %Y",$4 / 1000);in_m=$5/1024/1024;out_m=$6/1024/1024; printf("%s\t%s\t%s\t%s\t%dM\t%dM\n",$4,times

Writing the same column frequently - anti pattern?

2015-02-05 Thread Andreas Finke
Hi, we are currently writing the same column within a row multiple times (up to 10 times a second). I am familiar with the concept of tombstones in SSTables. My question is: I assume that in our case in most cases when a column gets overwritten it still resides in the memtable. So I assume for

RE: Problems with user defined types (cql) and Datastax Java Driver

2015-02-05 Thread Andreas Finke
driver ml https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user as you'll have better chances to get an answer there. thanks On Thu, Feb 5, 2015 at 9:10 AM, Andreas Finke mailto:andreas.fi...@solvians.com>> wrote: Hi, I encountered the problem that in Java the S

Problems with user defined types (cql) and Datastax Java Driver

2015-02-05 Thread Andreas Finke
Hi, I encountered the problem that in Java the Session does not create a valid UserType for my corresponding CQL user defined type. CQL_SCHEMA: create keyspace if not exists quotes WITH replication = { 'class' : 'SimpleStrategy', 'replication_factor' : 1 }; CREATE TYPE IF NOT EXISTS quotes.pri

RE: How do replica become out of sync

2015-01-19 Thread Andreas Finke
Hi, right, QUORUM means that data is written to all replicas but the coordinator waits for QUORUM responses before returning back to client. If a replica is out of sync due to network or internal issue than consistency is ensured through: - HintedHandoff (Automatically http://www.datastax.com

RE: how dump a query result into csv file

2015-01-12 Thread Andreas Finke
I think this might be what you are looking for http://www.datastax.com/documentation/cql/3.1/cql/cql_reference/copy_r.html Andi From: Rahul Bhardwaj [rahul.bhard...@indiamart.com] Sent: 12 January 2015 09:22 To: user Subject: how dump a query result into csv file

RE: Why read row is so slower than read column.

2014-12-27 Thread Andreas Finke
Hi, I would recommend to turn tracing on in CQL. Using this you can find out that part of the query results in high latency. http://www.datastax.com/documentation/cql/3.0/cql/cql_reference/tracing_r.html Regards Andi From: yhq...@sina.com [yhq...@sina.com] Sent

RE: mysql based columnar DB to Cassandra DB - Migration

2014-11-25 Thread Andreas Finke
Hi Akshay, this heavily depends on your data model. There is no general way to do it. It includes several steps: 1) Migration of applications using Mysql to Cassandra 2) Migration of the Mysql Database to Cassandra itself Keep in mind that there are no such things like relations or joins in Ca

RE: Upgrade: C* 2.0.8 -> C* 2.1.1 - Ten thousands of sstable files

2014-11-20 Thread Andreas Finke
20, 2014 at 10:25 AM, Andreas Finke mailto:andreas.fi...@solvians.com>> wrote: Hi Robert, thanks for your fast reply. Luckily this was a upgrade in QA environment ;) We are running SizeTierCompaction. I wonder whether all those files were created during running sstables command. Unfortu

RE: Upgrade: C* 2.0.8 -> C* 2.1.1 - Ten thousands of sstable files

2014-11-20 Thread Andreas Finke
20, 2014 at 7:00 AM, Andreas Finke mailto:andreas.fi...@solvians.com>> wrote: we upgraded a 6 node Cluster from Cassandra 2.0.7 to 2.1.1 recently sticking to this guide After upgrade cluster was less responsive than before. One node did not came up at all. For the record

Upgrade: C* 2.0.8 -> C* 2.1.1 - Ten thousands of sstable files

2014-11-20 Thread Andreas Finke
Hi, we upgraded a 6 node Cluster from Cassandra 2.0.7 to 2.1.1 recently sticking to this guide: http://www.datastax.com/documentation/upgrade/doc/upgrade/cassandra/upgradeCassandraDetails.html After upgrade cluster was less responsive than before. One node did not came up at all. When checking

RE: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-22 Thread Andreas Finke
Hi Phil, I found an interesting blog entry that may address your problem. http://www.datastax.com/dev/blog/optimizations-around-cold-sstables It seems that compaction is skipped for stables which so mit satisfy a certain read rate. Please check. Kind regards Andreas Finke Java Developer

RE: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-21 Thread Andreas Finke
Hi Phil, there is no dump question ;) What is your size estimation based on e.g. what size is a column in your calculation? From: Phil Luckhurst [phil.luckhu...@powerassure.com] Sent: Wednesday, May 21, 2014 5:42 PM To: cassandra-u...@incubator.apache.org

RE: Tombstones

2014-05-17 Thread Andreas Finke
Hi Dimetrio, >From the wiki: Since 0.6.8, minor compactions also GC tombstones Regards Andi Dimetrio wrote Does cassandra delete tombstones during simple LCS compaction or I should use node tool repair? Thanks. -- View this message in context: http://cassandra-user-incubator-ap

RE: Data File Mechanism

2013-12-20 Thread Andreas Finke
Hi Bonnet, regarding http://www.datastax.com/documentation/cql/3.1/webhelp/index.html#cql/cql_reference/cql_storage_options_c.html#concept_ds_xnr_4mw_xj__moreCompaction there is the setting sstable_size_in_mb // The target size for SSTables that use the leveled compaction strategy. for Level

RE: Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-20 Thread Andreas Finke
thelastpickle.com On 12/12/2013, at 11:49 pm, Andreas Finke wrote: > Hi, > > after adding 2 more nodes to a 4 nodes cluster (before) we are experiencing > high load on both new nodes. After doing some investigation we found out the > following: > > - High cpu load on vm5+6 >

Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-12 Thread Andreas Finke
Hi, after adding 2 more nodes to a 4 nodes cluster (before) we are experiencing high load on both new nodes. After doing some investigation we found out the following: - High cpu load on vm5+6 - Higher data load on vm5+6 - Write requests are evenly distributed to all 6 nodes by our client appl