Missing table suffix in data directory directories

2016-10-08 Thread Jason Kania
Hello, In the data directory of my 3.0.9 installation, I have directories with both suffixes and without: periodicReading periodicReadingTemp-76eb7510096811e68a7421c8b9466352 The directories with and without suffixes are being updated and for those with a suffix, the suffix matches the output of

Re: Understanding cassandra data directory contents

2016-10-08 Thread Jason Kania
these unused directories? Thanks, Jason Kania From: Vladimir Yudovin To: user@cassandra.apache.org; Jason Kania Sent: Saturday, October 8, 2016 2:05 PM Subject: Re: Understanding cassandra data directory contents Each table has unique id (suffix). If you drop and then recreate

Understanding cassandra data directory contents

2016-10-08 Thread Jason Kania
Hello, I am using Cassandra 3.0.9 and I have encountered an issue where the nodes in my 3 node cluster have vastly different amounts of data even though they should be roughly the same. When I looked through the data directory for my database on two of the nodes, I see a number of directories wi

Re: Nodetool repair inconsistencies

2016-06-08 Thread Jason Kania
Jason From: Paul Fife To: user@cassandra.apache.org; Jason Kania Sent: Wednesday, June 8, 2016 12:55 PM Subject: Re: Nodetool repair inconsistencies Hi Jason - Did you run a major compaction after the repair completed? Do you have other reasons besides the number/size of sstables to bel

Re: Nodetool repair inconsistencies

2016-06-08 Thread Jason Kania
compact error. Thanks, Jason From: Romain Hardouin To: "user@cassandra.apache.org" ; Jason Kania Sent: Wednesday, June 8, 2016 8:30 AM Subject: Re: Nodetool repair inconsistencies Hi Jason, It's difficult for the community to help you if you don't share the error ;

Nodetool repair inconsistencies

2016-06-07 Thread Jason Kania
I am running a 3 node cluster of 3.0.6 instances and encountered an error when running nodetool compact. I then ran nodetool repair. No errors were returned. I then attempted to run nodetool compact again, but received the same error so the repair made no correction and reported no errors. After

Re: Inconsistent query results and node state

2016-03-31 Thread Jason Kania
nning? On Wed, Mar 30, 2016 at 9:59 AM, Kai Wang wrote: Do you have NTP setup on all nodes? On Tue, Mar 29, 2016 at 11:48 PM, Jason Kania wrote: We have encountered a query inconsistency problem wherein the following query returns different results sporadically with invalid values for a time

Re: Inconsistent query results and node state

2016-03-31 Thread Jason Kania
Thanks for the response. All nodes are using NTP. Thanks, Jason From: Kai Wang To: user@cassandra.apache.org; Jason Kania Sent: Wednesday, March 30, 2016 10:59 AM Subject: Re: Inconsistent query results and node state Do you have NTP setup on all nodes? On Tue, Mar 29, 2016 at

Inconsistent query results and node state

2016-03-29 Thread Jason Kania
We have encountered a query inconsistency problem wherein the following query returns different results sporadically with invalid values for a timestamp field looking like the field is uninitialized (a zero timestamp) in the query results. Attempts to repair and compact have not changed the res

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-12 Thread Jason Kania
, these queries focus on raw, bulk retrieval of sensor data readings, but do you have reading-based queries, such as range of an actual sensor reading? -- Jack Krupansky On Fri, Mar 11, 2016 at 7:08 PM, Jason Kania wrote: The 5000 readings mentioned would be against a single sensor on a single sensor

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-12 Thread Jason Kania
ndle on the query side of the fence. -- Jack Krupansky On Fri, Mar 11, 2016 at 5:37 PM, Jason Kania wrote: Jack, Thanks for the response. We are targeting our database design to 1 sensor units and each sensor unit has 32 sensors. We are seeing about 700 events per day per sensor, each provi

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-11 Thread Jason Kania
roach it. A question: Is the probability of a timeout directly linked to a longer seek time in reading through a partition's contents? If that is the case, splitting the partition keys into a separate table would be straightforward. Regards, Jason From: Jack Krupansky To: user@cassandra

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-11 Thread Jason Kania
understanding all of this other stuff upfront. -- Jack Krupansky On Thu, Mar 10, 2016 at 12:39 PM, Jason Kania wrote: Jack, Thanks for the response. I don't think I provided enough information and used the wrong terminology as your response is more the canned advice is response to Cassandra

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
list of partition keys for the table because we cannot reduce the scope with a where clause. If there is a recommended pattern that solves this, we haven't come across it. I hope makes the problem clearer. Thanks, Jason From: Jack Krupansky To: user@cassandra.apache.org; Jason Kan

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
ld be appreciated. Thanks, Jason From: Jonathan Haddad To: user@cassandra.apache.org; Jason Kania Sent: Thursday, March 10, 2016 11:21 AM Subject: Re: Strategy for dividing wide rows beyond just adding to the partition key Have you considered making the date (or week, or whatever, some

Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
Hi, We have sensor input that creates very wide rows and operations on these rows have started to timeout regulary. We have been trying to find a solution to dividing wide rows but keep hitting limitations that move the problem around instead of solving it. We have a partition key consisting of

Re: How to complete bootstrap with exception due to stream failure?

2016-02-28 Thread Jason Kania
I raised https://issues.apache.org/jira/browse/CASSANDRA-11273 with these details and the workaround that I found. From: Paulo Motta To: "user@cassandra.apache.org" ; Jason Kania Sent: Sunday, February 28, 2016 10:01 PM Subject: Re: How to complete bootstrap with except

Re: How to complete bootstrap with exception due to stream failure?

2016-02-27 Thread Jason Kania
onnectionHandler.java:262 - [Stream #c9868f90-ddbb-11e5-80c0-89f591237aca] Received null From: Sebastian Estevez To: user@cassandra.apache.org; Jason Kania Sent: Saturday, February 27, 2016 8:24 PM Subject: Re: How to complete bootstrap with exception due to stream failure? progress: 3

How to complete bootstrap with exception due to stream failure?

2016-02-27 Thread Jason Kania
Hello, I am trying to get a node bootstrapped in 3.0.3, but just at the point where the bootstrap process is to complete, a broken pipe exception occurs so the bootstrap process hangs. Once I kill the bootstrap process, I can execute "nodetool bootstrap resume" again and the same problem will oc

Migrating from single node to cluster

2016-02-25 Thread Jason Kania
Hi, I am wondering if there is any documentation on migrating from a single node cassandra instance to a multinode cluster? My searches have been unsuccessful so far and I have had no luck playing with tools due to terse output from the tools. I currently use a single node having data that must

Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Jason Kania
Thanks for the tool reference. That will help. The second part of my question was whether there is a way to actually perform data repair aside from copying data from a replica. Thanks, Jason From: Carlos Alonso To: user@cassandra.apache.org; Jason Kania Sent: Wednesday, February 24

Reenable data access after temporarily moving data out of data directory

2016-02-23 Thread Jason Kania
Hi, I encountered an error in Cassandra or the latest Oracle JVM that causes the JVM to terminate during compaction in my situation (CASSANDRA 11200). In trying work around the problem and access the data , I moved the data eg ma-NNN-big-Filter.db, ma-367-big-Data.db etc. out of the data directo

Re: Comprehensive documentation on Cassandra Data modelling

2014-12-16 Thread Jason Kania
Data modeling a distributed application requires a fundamental rethink of all the assumptions we've been taught for master/slave style databases. On Tue, Dec 16, 2014 at 10:46 AM, Jason Kania wrote: Hi, I have been having a few exchanges with contributors to the project around what is possi

Comprehensive documentation on Cassandra Data modelling

2014-12-16 Thread Jason Kania
Hi, I have been having a few exchanges with contributors to the project around what is possible with Cassandra and a common response that comes up when I describe functionality as broken or missing is that I am not modelling my data correctly. Unfortunately, I cannot seem to find comprehensive d

Access to locally partitioned data

2014-12-14 Thread Jason Kania
Hello, I am wondering if there is a way to obtain results from a table where only the results from the local partition are returned in the query? To give some background, my application requires millions of timers and since queue-like implementations are a bad fit/anti-pattern for Cassandra, I