Re: Re[2]: how wide can wide rows get?

2014-11-13 Thread Takenori Sato
We have up to a few hundreds of millions of columns in a super wide row. There are two major issues you should care about. 1. the wider the row is, the more memory pressure you get for every slice query 2. repair is row based, which means a huge row could be transferred at every repair 1 is not

Re: OR mapping for set appends…

2014-11-13 Thread DuyHai Doan
Alternatively build a SetWrapper that extends the Java sets interface and intercepts calls to add(), addAll(), remove() For each of these method, the SetWrapper will generate an appropriate UPDATE statement. This is more general purpose than just an AppendSet. TTL is another story, it is an

about collections limit

2014-11-13 Thread diwayou
can i scan collection (list, set) paged by limit?

Re[2]: how wide can wide rows get?

2014-11-13 Thread Plotnik, Alexey
We have 380k of them in some of our rows and it's ok. -- Original Message -- From: "Hannu Kröger" mailto:hkro...@gmail.com>> To: "user@cassandra.apache.org" mailto:user@cassandra.apache.org>> Sent: 14.11.2014 16:13:49 Subject: Re: how wide can wide rows get? The theoretical limit is mayb

Re: how wide can wide rows get?

2014-11-13 Thread Joe Ramsey
You can have up to 2 billion columns but there are some considerations. This article might be of some help. http://www.ebaytechblog.com/2012/08/14/cassandra-data-modeling-best-practices-part-2/#.VGWdT4enCS0

Re: how wide can wide rows get?

2014-11-13 Thread Hannu Kröger
The theoretical limit is maybe 2 billion but recommended max is around 10-20 thousand. Br, Hannu > On 14.11.2014, at 8.10, Adaryl Bob Wakefield, MBA > wrote: > > I’m struggling with this wide row business. Is there an upward limit on the > number of columns you can have? > > Adaryl "Bob"

how wide can wide rows get?

2014-11-13 Thread Adaryl "Bob" Wakefield, MBA
I’m struggling with this wide row business. Is there an upward limit on the number of columns you can have? Adaryl "Bob" Wakefield, MBA Principal Mass Street Analytics 913.938.6685 www.linkedin.com/in/bobwakefieldmba Twitter: @BobLovesData

OR mapping for set appends…

2014-11-13 Thread Kevin Burton
I’m trying to figure out the best way to handle things like set appends (and other CQL extensions) in traditional OR mapping. Our OR mapper does basic setFoo() .. then save() to write the record back to the database. So if foo is a Sett then I can set all members. But I want to do some appends w

Questiona about node repair

2014-11-13 Thread Di, Jieming
Hi There, I have a question about Cassandra node repair, there is a function called "forceTerminateAllRepairSessions();", so will the function terminate all the repair session in only one node, or it will terminate all the session in a ring? And when it terminates all repair sessions, does it j

TLS for clients on DSE

2014-11-13 Thread Danie Viljoen
Hi I configured TLS encryption for cqlsh and cassandra (open source). I now have to do it for DataStax Enterprise. I found the cassandra.yaml file (for DSE, .dse-4.5.3/resources/cassandra/conf. Same changes as previously..but not the same results. Any pointers? Regards Danie

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Eric Plowe
Are you sure that both DC's can communicate with each other over the necessary ports? On Thu, Nov 13, 2014 at 3:46 PM, Adil wrote: > yeh we started nodes one at timemy doubt is if we should configure > alse cassandra-topology.properties or not? we leave it with default vlaues > > 2014-11-13

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Adil
yeh we started nodes one at timemy doubt is if we should configure alse cassandra-topology.properties or not? we leave it with default vlaues 2014-11-13 21:05 GMT+01:00 Robert Coli : > On Thu, Nov 13, 2014 at 10:26 AM, Adil wrote: > >> Hi, >> we have two datacenter with those inof: >> >> Cas

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Robert Coli
On Thu, Nov 13, 2014 at 10:26 AM, Adil wrote: > Hi, > we have two datacenter with those inof: > > Cassandra version 2.1.0 > DC1 with 5 nodes > DC2 with 5 nodes > > we set the snitch to GossipingPropertyFileSnitch and in > cassandra-rackdc.properties we put: > in DC1: > dc=DC1 > rack=RAC1 > > in D

Cassandra communication between 2 datacenter

2014-11-13 Thread Adil
Hi, we have two datacenter with those inof: Cassandra version 2.1.0 DC1 with 5 nodes DC2 with 5 nodes we set the snitch to GossipingPropertyFileSnitch and in cassandra-rackdc.properties we put: in DC1: dc=DC1 rack=RAC1 in DC2: dc=DC2 rack=RAC1 and in every node's cassandra.yaml we define two se

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Alex Popescu
On Wed, Nov 12, 2014 at 2:44 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > Hi, > > Is there a way to detect which version of Cassandra one is running? > Is there an API for that, or a constant with this value, or maybe an MBean > or some other way to get to this info? > > Here's the

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Jonathan Haddad
Tables, yes, but that wasn't the question. The question was around using different keyspaces. On Thu Nov 13 2014 at 9:17:30 AM Tyler Hobbs wrote: > That's not necessarily true. You don't need to split them into separate > keyspaces, but separate tables may have some advantages. For example, i

Re: Problems with unbalanced write requests using TokenAware policy

2014-11-13 Thread Jens Rantil
...and you are sure your server does not hold a (name, value) hotspot? Just an idea, Jens — Sent from Mailbox On Tue, Nov 11, 2014 at 9:38 PM, Gabriel Menegatti wrote: > Hello, > We are facing a "difficult" problem when trying to use the TokenAware > policy when performing writes, as our wr

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Tyler Hobbs
That's not necessarily true. You don't need to split them into separate keyspaces, but separate tables may have some advantages. For example, in Cassandra 2.1, compaction and index summary management are optimized based on read rates for SSTables. If you have different read rates or patterns for

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Jonathan Haddad
Performance will be the same. There's no performance benefit to using multiple keyspaces. On Thu Nov 13 2014 at 8:42:40 AM Li, George wrote: > Hi, > we use Cassandra to store some association type of data. For example, > store user to course (course registrations) association and user to school

Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Li, George
Hi, we use Cassandra to store some association type of data. For example, store user to course (course registrations) association and user to school (school enrollment) association data. The schema for these two types of associations are the same. So there are two options to store the data: 1. Put

Re: Better option to load data to cassandra

2014-11-13 Thread Shane Hansen
So sstableloader is a cpu efficient online method of loading data if you already have sstables. An option you may not have considered is just using batch inserts. It was a surprise to me coming from another database system, but C*'s primary use case is shoving data to an append only log. Is there

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Tim Dunphy
This is interesting. If I do a SELECT release_version from system.local; on my system it's telling me that I'm using 2.1.1 [root@beta-new:/usr/local/apache-cassandra-2.1.2] #cqlsh Connected to Jokefire Cluster at beta-new.jokefire.com:9042. [cqlsh 5.0.1 | Cassandra 2.1.1 | CQL spec 3.2.0 | Native

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Chris Lohfink
There is a "ReleaseVersion" attribute in the org.apache.cassandra.db:StorageService bean --- Chris Lohfink On Wed, Nov 12, 2014 at 5:57 PM, Michael Shuler wrote: > On 11/12/2014 04:58 PM, Michael Shuler wrote: > >> On 11/12/2014 04:44 PM, Otis Gospodnetic wrote: >> >>> Is there a way to detect

Re: Better option to load data to cassandra

2014-11-13 Thread Jonathan Lacefield
Here's another post which is pretty comprehensive for this topic. http://informationsurvival.blogspot.com/2014/02/cassandra-cql3-integration.html [image: datastax_logo.png] Jonathan Lacefield Solution Architect | (404) 822 3487 | jlacefi...@datastax.com [image: linkedin.png]

Re: Cassandra sort using updatable query

2014-11-13 Thread Chamila Wijayarathna
Hi Jonathan, Thank you very much, it worked this way. On Thu, Nov 13, 2014 at 12:07 AM, Jonathan Haddad wrote: > With Cassandra you're going to want to model tables to meet the > requirements of your queries instead of like a relational database where > you build tables in 3NF then optimize aft

Re: Better option to load data to cassandra

2014-11-13 Thread Robert Coli
On Wed, Nov 12, 2014 at 5:19 PM, cass savy wrote: > Sstableloader works well for large tables if you want to move data from > Cassandra to Cassandra. This works if both C* are on the same version. > > Sstable2json and json2sstable is another alternative. > This post is getting a bit long in the t