Re: High latencies for simple queries

2015-03-27 Thread Ben Bromhead
; scenarios this difference can matter. >> >> The question is: is it normal for Cassandra to have a minimum latency of >> 1 millisecond? >> >> I'm using Cassandra 2.1.2, python-driver. >> >> >> > > > -- > Tyler Hobbs > DataStax <http://datastax.com/> > -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr <http://twitter.com/instaclustr> | (650) 284 9692

Re: High latencies for simple queries

2015-03-27 Thread Ben Bromhead
" option which improves >>>> fsync() performance a lot. I have partitions mounted with this option and I >>>> did a test from Python, using psycopg2 driver, and I got the following >>>> latencies, in milliseconds: >>>> - INSERT without COMMIT: 0.0

Re: Arbitrary nested tree hierarchy data model

2015-03-27 Thread Ben Bromhead
hich does not appear to be very viable as looking up >> the entire tree would be ridiculous). >> > >> > The hope is to end up with a data model that allows us to display the >> entire tree quickly, as well as see the entire path to a leaf when >> sele

Re: High latencies for simple queries

2015-03-28 Thread Ben Bromhead
lower than the internal C* python driver, but this might be a question for python-driver folk. On 28 March 2015 at 00:34, Artur Siekielski wrote: > On 03/28/2015 12:13 AM, Ben Bromhead wrote: > >> One other thing to keep in mind / check is that doing these tests >> locally th

Re: Data migration

2015-04-14 Thread Ben Bromhead
igration schema can change(add or remove one, two fields). Could you >> please suggest some tool? >> >> > -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr <http://twitter.com/instaclustr> | (650) 284 9692

Re: Java 8

2015-05-07 Thread Ben Bromhead
:00 Stefan Podkowinski > >: >> >> Hi >>> >>> >>> >>> Are there any plans to support Java 8 for Cassandra 2.0, now that Java 7 >>> is EOL? >>> >>> Currently Java 7 is also recommended for 2.1. Are there any reasons n

Re: Multiple cassandra instances per physical node

2015-05-26 Thread Ben Bromhead
s a good point, yes. I'd still personally prefer the operational > simplicity of simply spacing out token assignments though, but YMMV. > > > > -- > --------- > Nate McCall > Austin, TX > @zznate > > Co-Founder & Sr. Technical Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr <http://twitter.com/instaclustr> | (650) 284 9692

Re: check active queries on cluster

2015-06-01 Thread Ben Bromhead
ahul.bhard...@indiamart.com> wrote: > > We want to track active queries on cassandra cluster. Is there any tool or > way to find all active queries on cassandra ? > > > > You can get a count of them with : > > > > https://issues.apache.org/jira/browse/CASSANDRA-5084 > > > > =Rob > > > -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr <http://twitter.com/instaclustr> | (650) 284 9692

Re: Spark SQL JDBC Server + DSE

2015-06-02 Thread Ben Bromhead
gt; the sender at the email above and delete this email and any attachments and >> destroy any copies thereof. Any review, retransmission, dissemination, >> copying or other use of, or taking any action in reliance upon, this >> information by persons or entities other than the

Re: Lucene index plugin for Apache Cassandra

2015-06-11 Thread Ben Bromhead
s guaranteed. > > > We hope this will be useful to the Apache Cassandra community. > > > Regards, > > -- > > Andrés de la Peña > > > <http://www.stratio.com/> > Avenida de Europa, 26. Ática 5. 3ª Planta > 28224 Pozuelo de Alarcón, Madrid > Te

Re: Deploying OpsCenter behind a HTTP(S) proxy

2015-06-18 Thread Ben Bromhead
/meta >>/rc >>/tcp >> >> Is there something I can configure in OpsCenter so that it serves these >> URLs from somewhere else, or a list of known URLs that I can remap on the >> proxy, or better yet, a known proxy configuration to put in front of >> OpsCenter? >> >> Regards, >> >> Jonathan >> > > -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr <http://twitter.com/instaclustr> | (650) 284 9692

Re: PropertiesFileSnitch

2013-12-09 Thread Ben Bromhead
to define its dc / rack and it will use gossip to discover this information about other nodes. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 10 Dec 2013, at 5:31 am, Marcelo Elias Del Valle wrote: > Hello everyone, > > I have a cassandr

Re: in AWS is it worth trying to talk to a server in the same zone as your client?

2014-02-12 Thread Ben Bromhead
/apidocs/com/datastax/driver/core/policies/LoadBalancingPolicy.html … and set the distance based on which zone the node is in. An alternate method would be to define the zones as data centres and then you could leverage existing DC aware policies (We've never tried this though). Ben Bro

Re: Recommended OS

2014-02-12 Thread Ben Bromhead
m linux in production (after all the warnings), run most of your cluster on linux, then run a single node or a separate DC with SmartOS, Solaris, BeOS, OS/2, Minix, Windows 3.1 or whatever it is that you choose and let us know how it all goes! Cheers Ben Bromhead Instaclustr | www.instaclustr.com | @i

Re: Load balancing issue with virtual nodes

2014-04-28 Thread Ben Bromhead
Some imbalance is expected and considered normal: See http://wiki.apache.org/cassandra/VirtualNodes/Balance As well as https://issues.apache.org/jira/browse/CASSANDRA-7032 Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 29 Apr 2014, at 7:30 am, DuyHai Doan

Re: Connect Cassandra rings in datacenter and ec2

2014-04-29 Thread Ben Bromhead
be the way to go http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPN_CloudHub.html. Additionally to access your Cassandra instances from your other VPCs you can use VPC peering (within the same region). See http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/vpc-peering.html Ben

Re: Can Cassandra client programs use hostnames instead of IPs?

2014-05-13 Thread Ben Bromhead
the public IPs. If you run in a VPC without public addressing and want to connect from external hosts you will want to look at a VPN (http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_VPN.html). Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 13/05/201

Re: Storing log structured data in Cassandra without compactions for performance boost.

2014-05-16 Thread Ben Bromhead
round can make range queries slower (the query has more files to visit). See http://stackoverflow.com/questions/8917882/cassandra-sstables-and-compaction (a little old but still relevant). Compaction also fixes up things like merging row fragments (when you write new columns to the same ro

Re: Ec2 Network I/O

2014-05-20 Thread Ben Bromhead
Also once you've got your phi_convict_threshold sorted, if you see these again check: http://status.aws.amazon.com/ AWS does occasionally have the odd increased latency issue / outage. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 19/05/2014, at 1:

Re: autoscaling cassandra cluster

2014-05-21 Thread Ben Bromhead
nonetheless. Datastax OpsCenter also provides capacity planning and forecasting and can provide an easy set of metrics you can make your scaling decisions on. http://www.datastax.com/what-we-offer/products-services/datastax-opscenter Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr

Re: Multi-DC Environment Question

2014-05-29 Thread Ben Bromhead
-in-cassandra Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 30 May 2014, at 8:40 am, Tupshin Harper wrote: > When one node or DC is down, coordinator nodes being written through will > notice this fact and store hints (hinted handoff is the mechani

Re: Managing truststores with inter-node encryption

2014-05-30 Thread Ben Bromhead
Java ssl sockets need to be able to build a chain of trust. So having either a nodes public cert or the root cert in the truststore works (as you found out). To get cassandra to use cypher suites > 128 bit you will need to install the JCE unlimited strength jurisdiction policy files. You will know

Re: VPC AWS

2014-06-10 Thread Ben Bromhead
Cassandra in a VPC solution, but we haven’t ever used it in a production environment or with a heavy load, so caveat emptor. As for the snitch… the GPFS is definitely the most flexible. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 10 Jun 2014, at 1:42 am

Re: Minimum Cluster size to accommodate a single node failure

2014-06-17 Thread Ben Bromhead
Yes your thinking is correct. This article from TLP sums it all up beautifully http://thelastpickle.com/blog/2011/06/13/Down-For-Me.html Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 18 Jun 2014, at 4:18 pm, Prabath Abeysekara wrote: > Sorry, the ti

Re: EBS SSD <-> Cassandra ?

2014-06-18 Thread Ben Bromhead
. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 18 Jun 2014, at 7:18 pm, Daniel Chia wrote: > While they guarantee IOPS, they don't really make any guarantees about > latency. Since EBS goes over the network, there's so many things in the pa

Re: EBS SSD <-> Cassandra ?

2014-06-19 Thread Ben Bromhead
Nate you are right in that it is a function of logical separation helps for some reason. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 20 Jun 2014, at 8:17 am, Nate McCall wrote: > Sorry - should have been clear I was speaking in terms of ro

Re: possible to have TTL on individual collection values?

2014-07-17 Thread Ben Bromhead
Create a table with a set as one of the columns using cqlsh, populate with a few records. Connect using the cassandra-cli, run list on your table/cf and you'll see how the sets work. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 13/07/2014, at 11:

Re: any plans for coprocessors?

2014-07-27 Thread Ben Bromhead
http://www.datastax.com/dev/blog/whats-new-in-cassandra-2-0-prototype-triggers-support http://www.datastax.com/documentation/cql/3.1/cql/cql_reference/trigger_r.html Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 26 Jul 2014, at 11:32 am, Kevin Burton wrote

Re: Using an EC2 cluster from the outside.

2013-04-17 Thread Ben Bromhead
Depending on your client, disable automatic client discovery and just specify a list of all your nodes in your client configuration. For more details check out http://xzheng.net/blogs/problem-when-connecting-to-cassandra-with-ruby/ , obviously this deals specifically with a ruby client but it s

Re: Installing specific version

2013-07-07 Thread Ben Bromhead
On ubuntu it is: apt-get install cassandra=1.2.4 So should be similar for debian Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 05/07/2013, at 10:59 PM, Kais Ahmed wrote: > Hi ben, > > You can get it from http://archive.apache.org/dist/

Re: Which of these VPS configurations would perform better for Cassandra ?

2013-08-04 Thread Ben Bromhead
norm (SmartOS is based on Solaris). Just make sure you test and benchmark all your options, a few days of testing now will save you weeks of pain. Good luck! Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr On 05/08/2013, at 12:34 AM, David Schairer wrote: > Of course -- my point i

Re: Recommendation for hosting multi tenant clusters

2013-08-13 Thread Ben Bromhead
Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 14/08/2013, at 10:42 AM, Jon Haddad wrote: > I strongly recommend against EBS, even with optimized & ebs provisioned. The > throughput you'll get from local drives is significantly better than wha

<    1   2