Re: Cassandra Needs to Grow Up by Version Five!

2018-02-18 Thread Jeff Jirsa
Comments inline > On Feb 18, 2018, at 9:39 PM, Kenneth Brotman > wrote: > > Cassandra feels like an unfinished program to me. The problem is not that > it’s open source or cutting edge. It’s an open source cutting edge program > that lacks some of its basic functionality. We are all stuck

Cassandra Needs to Grow Up by Version Five!

2018-02-18 Thread Kenneth Brotman
Cassandra feels like an unfinished program to me. The problem is not that it's open source or cutting edge. It's an open source cutting edge program that lacks some of its basic functionality. We are all stuck addressing fundamental mechanical tasks for Cassandra because the basic code that woul

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread Rahul Singh
If that is the case you could also try to run more stress from another machine as well. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Feb 18, 2018, 2:37 PM -0500, Jeff Jirsa , wrote: > Stress client may be cpu bound as well > > -- > Jeff Jirsa > > > On Feb 18, 2018, at 7:40 AM, onmst

Re: Cassandra data model too many table

2018-02-18 Thread Jeff Jirsa
You’re basically looking to query and aggregate the data arbitrarily - you may have better luck using spark or solr pointing to a single backing table in Cassandra -- Jeff Jirsa > On Feb 18, 2018, at 3:38 AM, onmstester onmstester > wrote: > > I have a single structured row as input wit

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread Jeff Jirsa
Stress client may be cpu bound as well -- Jeff Jirsa > On Feb 18, 2018, at 7:40 AM, onmstester onmstester > wrote: > > I'm running tests on separate machine (not member of the cluster) > I'm using the default data model of cassandra-stress tool : keyspace1 and > table: standard1. nothing sp

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread onmstester onmstester
I'm running tests on separate machine (not member of the cluster) I'm using the default data model of cassandra-stress tool : keyspace1 and table: standard1. nothing special on network or data traffic. Network capable of 1 G and tested it with ipperf. iftop shows maximum of 48Mbit traffic betwe

Re: SSTableLoader Question

2018-02-18 Thread Rahul Singh
If you don’t have access to the file you don’t have access to the file. I’ve seen this issue several times. It’s he easiest low hanging fruit to resolve. So figure it out and make sure that it’s Cassandra.Cassandra from root to he Data folder and either run as root or sudo it. If it’s compacted

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread Rahul Singh
Got it. Here are some other questions. Are you running the test on separate machine or one of the cluster members? When configuring Cassandra stress what data model did you end up using? ( do you see Data or traffic skew?) Do you see any wide partitions or Tombstone warnings on either node. H

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread onmstester onmstester
But monitoring cassandra with jmx using jvisualVM shows no problem, less than 30% of heap size used Sent using Zoho Mail On Sun, 18 Feb 2018 17:26:59 +0330 Rahul Singh wrote You don’t don’t have enough memory. That’s just a start. -- Rahul

Re: SSTableLoader Question

2018-02-18 Thread shalom sagges
Not really sure with which user I ran it (root or cassandra), although I don't understand why a permission issue will generate a File not Found exception? And in general, what if a file is being streamed and got compacted before the streaming ended. Does Cassandra know how to handle this? Thanks!

Re: SSTableLoader Question

2018-02-18 Thread Rahul Singh
Check permissions maybe? Who owns the files vs. who is running sstableloader. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Feb 18, 2018, 4:26 AM -0500, shalom sagges , wrote: > Hi All, > > C* version 2.0.14. > > I was loading some data to another cluster using SSTableLoader. The stre

Re: Cassandra cluster: could not reach linear scalability

2018-02-18 Thread Rahul Singh
You don’t don’t have enough memory. That’s just a start. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Feb 18, 2018, 6:29 AM -0500, onmstester onmstester , wrote: > I've configured a simple cluster using two PC with identical spec: > cpu core i5 > RAM: 8GB ddr3 > Disk: 1TB 5400r

Re: Cassandra data model too many table

2018-02-18 Thread Rahul Singh
What’s the root cause of this many queries? Is this because of multi tenancy or multiple processes ? It’s possible to potentially logically group some of this data if you use collections / sets inside a column. That works if the data is of a similar structure of a similar query. It’s “semi-n

Cassandra data model too many table

2018-02-18 Thread onmstester onmstester
I have a single structured row as input with rate of 10K per seconds. Each row has 20 columns. Some queries should be answered on these inputs. Because most of queries needs different where, group by or orderby, The final data model ended up like this: primary key for table of query1 : ((colum

Cassandra cluster: could not reach linear scalability

2018-02-18 Thread onmstester onmstester
I've configured a simple cluster using two PC with identical spec: cpu core i5 RAM: 8GB ddr3 Disk: 1TB 5400rpm Network: 1 G (I've test it with iperf, it really is!) using the common configs described in many sites including datastax itself: cluster_name: 'MyCassandraCluster' num_tokens: 256 se

SSTableLoader Question

2018-02-18 Thread shalom sagges
Hi All, C* version 2.0.14. I was loading some data to another cluster using SSTableLoader. The streaming failed with the following error: Streaming error occurred java.lang.RuntimeException: java.io.*FileNotFoundException*: /data1/keyspace1/table1/keyspace1-table1-jb-65174-Data.db (No such file