Re: CorruptSSTableException in system_auth keyspace

2014-02-28 Thread Ondřej Černoš
. On Fri, Feb 28, 2014 at 11:09 AM, Ondřej Černoš wrote: > Hello, > > we are trying to add authentication to our Cassandra cluster. We add our > authenticated users during puppet deployment using the default user, which > is then disabled. > > We have the following

CorruptSSTableException in system_auth keyspace

2014-02-28 Thread Ondřej Černoš
Hello, we are trying to add authentication to our Cassandra cluster. We add our authenticated users during puppet deployment using the default user, which is then disabled. We have the following issues: - we see CorruptSSTableException in system_auth.users table - we are not able to add users af

Re: Intermittent long application pauses on nodes

2014-02-17 Thread Ondřej Černoš
th Cassandra in our > testing. There are a number of changes going in soon that may change that, > but for the time being it is advisable to stick with CMS. With tuning you > can no doubt bring your pauses down considerably. > > > On 17 February 2014 10:17, Ondřej Černoš wrote: &

Re: Intermittent long application pauses on nodes

2014-02-17 Thread Ondřej Černoš
Hi all, we are seeing the same kind of long pauses in Cassandra. We tried to switch CMS to G1 without positive result. The stress test is read heavy, 2 datacenters, 6 nodes, 400reqs/sec on one datacenter. We see spikes in latency on 99.99 percentil and higher, caused by threads being stopped in JV

Re: exceptions all around in clean cluster

2014-02-06 Thread Ondřej Černoš
left in system keyspace as live though the keyspace was completely dropped? ondrej cernos On Thu, Feb 6, 2014 at 3:11 PM, Ondřej Černoš wrote: > I ran nodetool scrub on nodes in the less corrupted datacenter and tried > nodetool rebuild from this datacenter. > > This is the result:

Re: exceptions all around in clean cluster

2014-02-06 Thread Ondřej Černoš
at 2:38 PM, Ondřej Černoš wrote: > Hi, > > I am running a small 2 DC cluster of 3 nodes (each DC). I use 3 replicas > in both DCs (all 6 nodes have everything) on Cassandra 1.2.11. I populated > the cluster via cqlsh pipelined with a series of inserts. I use the cluster > for

exceptions all around in clean cluster

2014-02-06 Thread Ondřej Černoš
Hi, I am running a small 2 DC cluster of 3 nodes (each DC). I use 3 replicas in both DCs (all 6 nodes have everything) on Cassandra 1.2.11. I populated the cluster via cqlsh pipelined with a series of inserts. I use the cluster for tests, the dataset is pretty small (hundreds of thousands of recor

Re: question about secondary index or not

2014-01-29 Thread Ondřej Černoš
Hi, we had a similar use case. Just do the filtering client-side, the #2 example performs horribly, secondary indexes on something dividing the set into two roughly the same size subsets just don't work. Give it a try on localhost with just a couple of records (150.000), you will see. regards,

Re: various Cassandra performance problems when CQL3 is really used

2014-01-15 Thread Ondřej Černoš
Hi, by the way, some of the issues are summarised here: https://issues.apache.org/jira/browse/CASSANDRA-6586 and here: https://issues.apache.org/jira/browse/CASSANDRA-6587. regards, ondrej cernos On Tue, Jan 14, 2014 at 9:48 PM, Ondřej Černoš wrote: > Hi, > > thanks for the answer

Re: various Cassandra performance problems when CQL3 is really used

2014-01-14 Thread Ondřej Černoš
API. > Joins and indexes should generally be handled by denormlaising the data > during writes. > > It sounds like your data model was too relational, you need to denormalise > and read rows by primary key. Secondary indexes are useful when you have a > query pattern that is used infr

various Cassandra performance problems when CQL3 is really used

2013-12-17 Thread Ondřej Černoš
Hi all, we are reimplementing a legacy interface of an inventory-like service (currently built on top of mysql) on Cassandra and I thought I would share some findings with the list. The interface semantics is given and cannot be changed. We chose Cassandra due to its multiple datacenter capabiliti

Cassandra and Pig - CQL maps denormalisation

2013-11-19 Thread Ondřej Černoš
Hi all, I am solving a issue with pig integration with cassandra using CqlLoader. I don't know exactly if the problem is in CqlLoader, my low understanding of Pig (I hope this is actually the case) or some bug in the combination of Pig and CqlLoader. Sorry if this turns out to be rather a Pig ques

Re: Can't perform repair on a 1.1.5 cassandra node -SSTable corrupted

2013-08-07 Thread Ondřej Černoš
Hello, please see these issues: https://issues.apache.org/jira/browse/CASSANDRA-5686 and https://issues.apache.org/jira/browse/CASSANDRA-5391 if you hit any of them. regards, ondrej cernos On Wed, Aug 7, 2013 at 5:00 PM, Madalina Matei wrote: > Hi, > > I have a 5 nodes cassandra (version 1.1.

pagination in cql3

2013-05-24 Thread Ondřej Černoš
Hi all, I need to support a legacy API where page offset and limit are on the input of the API call (it used to be mapped directly to offset and limit MySQL select options). The data are pretty small (like really small, some hundreds of thousands narrow rows maximum - I use Cassandra for its multi

Re: Secondary Index on table with a lot of data crashes Cassandra

2013-05-02 Thread Ondřej Černoš
CQL 2? Try using the -2 option when starting cqlsh. regards, Ondřej Černoš On Thu, Apr 25, 2013 at 10:32 AM, wrote: > IMHO: user_name is not a column, it is the row key. Therefore, according > to http://thelastpickle.com/2011/07/04/Cassandra-Query-Plans/ , the row > does not contain a

Re: Repair Freeze / Gossip Invisibility / EC2 Public IP configuration

2013-04-25 Thread Ondřej Černoš
Hi, I have similar issue with stuck repair. Similar multiregion setup, only between us-east and private cloud at rackspace. The log mentiones merkle tree exchanges and I see a lot of dropped communication: I will comment on your ticket in Jira. regards, ondrej cernos On Fri, Apr 19, 2013 at

Re: Secondary Index on table with a lot of data crashes Cassandra

2013-04-25 Thread Ondřej Černoš
Hi, if you are able to reproduce the issue, file a ticket on https://issues.apache.org/jira/browse/CASSANDRA - my experience is developers respond quickly on issues that are clearly a bug. regards, ondrej cernos On Thu, Apr 25, 2013 at 10:03 AM, Tamar Rosen wrote: > Hi, > > We have a case of

Plans for CQL3 (non-compact storage) table support in Cassandra's Pig support

2013-04-23 Thread Ondřej Černoš
would help. regards, ondřej černoš

Re: Compaction, truncate, cqlsh problems

2013-04-11 Thread Ondřej Černoš
of truncate? regards, Ondřej Černoš On Thu, Apr 11, 2013 at 5:04 PM, Edward Capriolo wrote: > If you do not have JNA truncate has to fork an 'ln -s'' command for the > snapshots. I think that makes it un-predicatable. Truncate has its own > timeout value now (separate

Compaction, truncate, cqlsh problems

2013-04-11 Thread Ondřej Černoš
found out there were some issues with race conditions and with slowing down if truncate is used frequently (as is my case, where truncate is run before each test in quite a big test suite). Any hints? Regards, Ondřej Černoš

Re: nodetool status inconsistencies, repair performance and system keyspace compactions

2013-04-04 Thread Ondřej Černoš
of compactions I reported in the previous email was not triggered. And is there a documentation where I could find the exact semantics of repair when vnodes are used (and what -pr means in such a setup) and when run in multiple datacenter setup? I still don't quite get it. regards, Ondřej Č

Re: java.io.IOException: FAILED_TO_UNCOMPRESS(5) exception when running nodetool rebuild

2013-03-27 Thread Ondřej Černoš
a/browse/CASSANDRA-5381 > > Cheers > > - > Aaron Morton > Freelance Cassandra Consultant > New Zealand > > @aaronmorton > http://www.thelastpickle.com > > On 26/03/2013, at 5:10 AM, Ondřej Černoš wrote: > > Hi all, > > I am still unable to move forward with t

nodetool status inconsistencies, repair performance and system keyspace compactions

2013-03-26 Thread Ondřej Černoš
Hi all, I have 2 DCs, 3 nodes each, RF:3, I use local quorum for both reads and writes. Currently I test various operational qualities of the setup. During one of my tests - see this thread in this mailing list: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/java-io-IOException

Re: java.io.IOException: FAILED_TO_UNCOMPRESS(5) exception when running nodetool rebuild

2013-03-25 Thread Ondřej Černoš
, 2013 at 5:51 PM, Ondřej Černoš wrote: > Hi all, > > I am running into strange error when bootstrapping Cassandra cluster > in multiple datacenter setup. > > The setup is as follows: 3 nodes in AWS east, 3 nodes somewhere on > Rackspace/Openstack. I use my own snitch based on

Re: Composite columns

2013-03-20 Thread Ondřej Černoš
Hey, try this blog post by Datastax, it provides a good explanation of CQL3 abstractions. http://www.datastax.com/dev/blog/cql3-for-cassandra-experts regards, ondrej cernos On Wed, Mar 20, 2013 at 8:50 AM, Thierry Templier wrote: > Hello, > > I have a question regarding composite columns. Wha

java.io.IOException: FAILED_TO_UNCOMPRESS(5) exception when running nodetool rebuild

2013-03-19 Thread Ondřej Černoš
Hi all, I am running into strange error when bootstrapping Cassandra cluster in multiple datacenter setup. The setup is as follows: 3 nodes in AWS east, 3 nodes somewhere on Rackspace/Openstack. I use my own snitch based on EC2MultiRegionSnitch (it just adds some ec2 avalability zone parsing capa