Re: Need Column Family Schema Suggestion

2016-01-26 Thread srungarapu vamsi
Jack, This is one of the analytics jobs i have to run. For the given problem, i want to optimize the schema so that instead of loading the data as rdd to spark machines , i want to get the direct number from cassandra queries. The rationale behind this logic is i want to save on spark machine types

Re: Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Thank you all for your feedback. I and my team will take all these suggestions into account. Cheers Enrico Il giorno Mar 26 Gen 2016 23:51 Jack Krupansky ha scritto: > There is no documented support for embedded Cassandra. Sure, there is a > CassandraDaemon class and a EmbeddedCassandraService

Re: About cassandra's reblance when adding one or more nodes into the existed cluster?

2016-01-26 Thread 土卜皿
Hi Alain and Romain, I am so sorry for this issue! I should not use the command "nodetool move" because I set "num_tokens: 256" in every node's cassandra.yaml. However, I have new questions after adding two nodes into the cluster: node1: 192.21.0.184 node2: 192.21.0.185 After starting the two n

Re: Embedded cassandra

2016-01-26 Thread Jack Krupansky
There is no documented support for embedded Cassandra. Sure, there is a CassandraDaemon class and a EmbeddedCassandraService class, but they are intended for testing, not for use of the product. I have seen a couple of (old) references to people running embedded Cassandra (one in the official Wiki

Re: Logging

2016-01-26 Thread oleg yusim
Sam, Paulo, Thank you very much for explanations and references. Oleg On Mon, Jan 25, 2016 at 10:08 AM, Sam Tunnicliffe wrote: > Paulo is correct in saying that C* doesn't have a direct equivalent of > SecurityContextHolder. Authenticated principal info is retrievable from the > QueryState dur

Re: Embedded cassandra

2016-01-26 Thread Jonathan Haddad
Launching a distributed database inside of an application server does not make it easier to manage, it makes it a nightmare. Rebooting a node is easy, rebooting ALL your nodes when you do a deployment is pointless. On Tue, Jan 26, 2016 at 2:14 PM Enrico Olivelli wrote: > Hanks for your replies.

Re: Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Hanks for your replies. Actually my service uses a traditional jdbc database which is to be shared among all the peers. I'm looking for a shared-nothing db and Cassandra seems good. I'm already using HBase in production but it seems to me that Cassandra is more dynamic. No need for distributed fs l

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Otis Gospodnetić
Hi, On Tue, Jan 26, 2016 at 8:28 AM, Julien Anguenot wrote: > If you install the latest OpsCenter you will get a banner stating the > policy changes and linking to: > >http://docs.datastax.com/en/opscenter/5.2/opsc/opscPolicyChanges.html > > On our side, we decided to go with Sematext SPM to

Re: Embedded cassandra

2016-01-26 Thread Jonathan Haddad
For the sake of argument... why do you think you should embed Cassandra? I'll be honest with you, making Cassandra restart every time you want to upgrade your daemon sounds like a horrible idea. Run your 10 DB instances on their own and save yourself the operational headache. On Tue, Jan 26, 2016

Re: Need Column Family Schema Suggestion

2016-01-26 Thread Jack Krupansky
Step 1 in data modeling in Cassandra is to define all of your queries. Are these in fact the ONLY queries that you need? If you are doing significant analytics, Spark is indeed the way to go. Cassandra works best for point queries and narrow slice queries (sequence of consecutive rows within a si

Re: About cassandra's reblance when adding one or more nodes into the existed cluster?

2016-01-26 Thread Romain Hardouin
Hi Dillon,  CMIIW I suspect that you use vnodes and you want to "move one of the 256 tokens to another node". If yes, that's not possible."nodetool move" is not allowed with vnodes: https://github.com/apache/cassandra/blob/cassandra-2.1.11/src/java/org/apache/cassandra/service/StorageService.j

Re: Embedded cassandra

2016-01-26 Thread Richard L. Burton III
I'm certain you're going to get a lot of users on this mailing list telling you that's a bad idea. You should read up on Cassandra via datastax website to understand how Cassandra is designed and works. There's tools for monitoring and more. On Tue, Jan 26, 2016 at 2:31 PM, Enrico Olivelli wrote

Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Hi, I' new to Cassandra. I'm evaluating to launch Cassandra daemon inside the JVM of my program. This is essentially because I want the lifecycle of Cassandra to be managed by my daemon. My program can be launched on several machines (in the order of max 10 instances) and every instance collaborate

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-01-26 Thread Eric Stevens
There's still a race condition there, because two clients could SELECT at the same time as each other, then both INSERT. You'd be better served with a CAS operation, and let Paxos guarantee at-most-once execution. On Tue, Jan 26, 2016 at 9:06 AM Francisco Reyes wrote: > On 01/22/2016 10:29 PM,

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Chris Lohfink
DataStax has a free program for startups http://www.datastax.com/datastax-enterprise-for-startups On Tue, Jan 26, 2016 at 9:42 AM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi Duyhai, > > SPM is not free, but there is a free plan, plus we have special pricing > for startups, non-pro

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-01-26 Thread Francisco Reyes
On 01/22/2016 10:29 PM, Kevin Burton wrote: I sort of agree.. but we are also considering migrating to hourly tables.. and what if the single script doesn't run. I like having N nodes make changes like this because in my experience that central / single box will usually fail at the wrong time

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Alain RODRIGUEZ
Hi all, I can confirm that Sematext SPM is a working option for monitoring Cassandra. I used it for 1+ year. Their support is online most of the time, they are very friendly (starting with Otis) and comprehensive (go discuss with them if the only issue is pricing, you'll find a way) but overall c

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Otis Gospodnetić
Hi Duyhai, SPM is not free, but there is a free plan, plus we have special pricing for startups, non-profits, and education institutions. Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ On Tue, Jan 26, 20

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread DuyHai Doan
Hello Otis The Sematext tools, is it free or not ? And if not free, is there a "limited" open-source version ? On Tue, Jan 26, 2016 at 3:39 PM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi, > > As Julien pointed out, there is a good OpsCenter alternative at > https://sematext.com/

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Otis Gospodnetić
Hi, As Julien pointed out, there is a good OpsCenter alternative at https://sematext.com/spm/integrations/cassandra-monitoring.html Questions/comments/feedback/milk/cookies are all welcome. Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support

Re: How to make the new cassandra cluster balanced after adding one or more nodes?

2016-01-26 Thread Alain RODRIGUEZ
Hi Dillon, I advise you to keep writing in the same thread as long as it is about the same issue, to avoid spreading information. I answered your first email :-). C*heers, - Alain Rodriguez France The Last Pickle http://www.thelastpickle.com 2016-01-26 6:50 GMT+01:00 土卜皿 : > F

Re: About cassandra's reblance when adding one or more nodes into the existed cluster?

2016-01-26 Thread Alain RODRIGUEZ
Hi Dillon, I will assume you're using Murmur3 and that you *don't* use vnodes (ie "num_token" option commented in cassandra.yaml) as if vnodes are enabled this operation is useless (and maybe harmful, not sure about that) Can you give us the output of : $ *nodetool ring* It looks like your tryi

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Julien Anguenot
If you install the latest OpsCenter you will get a banner stating the policy changes and linking to: http://docs.datastax.com/en/opscenter/5.2/opsc/opscPolicyChanges.html On our side, we decided to go with Sematext SPM to replace OpsCenter for our 2.1 cluster and thus be able to upgrade to 2

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Hannu Kröger
Is it really like that? Where does this info come from? I haven’t seen anything “official" yet. Hannu > On 26 Jan 2016, at 15:07, > wrote: > > This is a very strange move considering how well DataStax has supported open > source Cassandra. I hope there is a reasonable and well-publicized >

RE: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread SEAN_R_DURITY
This is a very strange move considering how well DataStax has supported open source Cassandra. I hope there is a reasonable and well-publicized explanation for this apparent change in direction. Sean Durity From: George Sigletos [mailto:sigle...@textkernel.nl] Sent: Tuesday, January 26, 2016 4

RE: NullPointerException when trying to compact under 3.2

2016-01-26 Thread SEAN_R_DURITY
Can you wipe all the data directories, saved_cache, and commitlog and let the node bootstrap again? Sean Durity From: Nimi Wariboko Jr [mailto:n...@channelmeter.com] Sent: Monday, January 25, 2016 6:59 PM To: cassandra-u...@apache.org Subject: NullPointerException when trying to compact under 3

Need Column Family Schema Suggestion

2016-01-26 Thread srungarapu vamsi
Hi, I have the following use case: A product (P) has 3 or more Devices associated with it. Each device (Di) emits a set of names (size of the set is less than or equal to 250) every minute. Now the ask is: Compute the function f(product,hour) which is defined as follows: *foo*(*product*,*hour*) = N

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread George Sigletos
Unfortunately Datastax decided to discontinue Opscenter for open source Cassandra, starting from version 2.2. Pitty On Wed, Jan 6, 2016 at 6:00 PM, Michael Shuler wrote: > On 01/06/2016 10:55 AM, Michael Shuler wrote: > > On 01/06/2016 01:47 AM, Wills Feng wrote: > >> Looks like opscenter doesn