Re: Forming a cluster of embedded Cassandra instances

2016-02-17 Thread Binil Thomas
es would not support HA. You need to be able to >>> reach a quorum, which is defined as n/2+1 where n is the number of >>> replicas. IOW, you cannot update the data if a quorum cannot be reached. >>> The data on any given node needs to be replicated on at least two other >

Re: Forming a cluster of embedded Cassandra instances

2016-02-15 Thread Jack Krupansky
But again, you could also simply spawn a process running Cassandra as-is in its intended form which would eliminate the potential for conflict between the app heap and Casandra's JVM heap. -- Jack Krupansky On Mon, Feb 15, 2016 at 12:56 AM, Jan Kesten wrote: > Hi, > > the embedde

Re: Forming a cluster of embedded Cassandra instances

2016-02-14 Thread Jan Kesten
Hi, the embedded cassandra to speedup entering the project may will work for developers, we used it for junit. But a simple clone and maven build - I guess it will end in a single node cassandra cluster. Remember cassandra is a distributed database, one will need more than one node to get

Re: Forming a cluster of embedded Cassandra instances

2016-02-14 Thread John Sanda
es would not support HA. You need to be able to >>>> reach a quorum, which is defined as n/2+1 where n is the number of >>>> replicas. IOW, you cannot update the data if a quorum cannot be reached. >>>> The data on any given node needs to be replicated on at least two other &

Re: Forming a cluster of embedded Cassandra instances

2016-02-14 Thread Jack Krupansky
- 3, 5, 7 - so that split-brain >>> can be avoided. Two nodes would not support HA. You need to be able to >>> reach a quorum, which is defined as n/2+1 where n is the number of >>> replicas. IOW, you cannot update the data if a quorum cannot be reached. >>>

Re: Forming a cluster of embedded Cassandra instances

2016-02-14 Thread John Sanda
an >> be avoided. Two nodes would not support HA. You need to be able to reach a >> quorum, which is defined as n/2+1 where n is the number of replicas. IOW, >> you cannot update the data if a quorum cannot be reached. The data on any >> given node needs to be replicated on a

Re: Forming a cluster of embedded Cassandra instances

2016-02-13 Thread Jonathan Haddad
; given node needs to be replicated on at least two other nodes. > > Embedded Cassandra is only for extremely sophisticated developers - not > those who are new to Cassandra, with a "superficial understanding". > > As a general proposition, you should not be running applica

Re: Forming a cluster of embedded Cassandra instances

2016-02-13 Thread Jack Krupansky
given node needs to be replicated on at least two other nodes. Embedded Cassandra is only for extremely sophisticated developers - not those who are new to Cassandra, with a "superficial understanding". As a general proposition, you should not be running application code on Cassandra no

Forming a cluster of embedded Cassandra instances

2016-02-13 Thread Binil Thomas
dissemination infrastructure of embedded Cassandra? I am in the process of re-packaging a SaaS system written in Java to be deployed on-premise by customers. The SaaS system currently uses AWS DynamoDB. The data storage needs for this application are modest, but I would like to keep the

Re: Embedded cassandra

2016-01-27 Thread Jack Krupansky
6 Gen 2016 23:51 Jack Krupansky > ha scritto: > >> There is no documented support for embedded Cassandra. Sure, there is a >> CassandraDaemon class and a EmbeddedCassandraService class, but they are >> intended for testing, not for use of the product. >> >> I

Re: Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Thank you all for your feedback. I and my team will take all these suggestions into account. Cheers Enrico Il giorno Mar 26 Gen 2016 23:51 Jack Krupansky ha scritto: > There is no documented support for embedded Cassandra. Sure, there is a > CassandraDaemon class and a EmbeddedCassandraS

Re: Embedded cassandra

2016-01-26 Thread Jack Krupansky
There is no documented support for embedded Cassandra. Sure, there is a CassandraDaemon class and a EmbeddedCassandraService class, but they are intended for testing, not for use of the product. I have seen a couple of (old) references to people running embedded Cassandra (one in the official

Re: Embedded cassandra

2016-01-26 Thread Jonathan Haddad
Launching a distributed database inside of an application server does not make it easier to manage, it makes it a nightmare. Rebooting a node is easy, rebooting ALL your nodes when you do a deployment is pointless. On Tue, Jan 26, 2016 at 2:14 PM Enrico Olivelli wrote: > Hanks for your replies.

Re: Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Hanks for your replies. Actually my service uses a traditional jdbc database which is to be shared among all the peers. I'm looking for a shared-nothing db and Cassandra seems good. I'm already using HBase in production but it seems to me that Cassandra is more dynamic. No need for distributed fs l

Re: Embedded cassandra

2016-01-26 Thread Jonathan Haddad
For the sake of argument... why do you think you should embed Cassandra? I'll be honest with you, making Cassandra restart every time you want to upgrade your daemon sounds like a horrible idea. Run your 10 DB instances on their own and save yourself the operational headache. On Tue, Jan 26, 2016

Re: Embedded cassandra

2016-01-26 Thread Richard L. Burton III
I'm certain you're going to get a lot of users on this mailing list telling you that's a bad idea. You should read up on Cassandra via datastax website to understand how Cassandra is designed and works. There's tools for monitoring and more. On Tue, Jan 26, 2016 at 2:31 PM, Enrico Olivelli wrote

Embedded cassandra

2016-01-26 Thread Enrico Olivelli
Hi, I' new to Cassandra. I'm evaluating to launch Cassandra daemon inside the JVM of my program. This is essentially because I want the lifecycle of Cassandra to be managed by my daemon. My program can be launched on several machines (in the order of max 10 instances) and every instance collaborate

Re: Recommendations for an embedded Cassandra and Unit Tests

2016-01-13 Thread Richard L. Burton III
>> it'll return a list of statements inside of it? >> >> Looking at CQLParser, it's only good for parsing a single statement vs. a >> file that contains multiple statements. >> >> >> On Mon, Jan 11, 2016 at 3:06 PM, DuyHai Doan >> wrote: &g

Re: Recommendations for an embedded Cassandra and Unit Tests

2016-01-12 Thread DuyHai Doan
ngle statement vs. a > file that contains multiple statements. > > > On Mon, Jan 11, 2016 at 3:06 PM, DuyHai Doan wrote: > >> Achilles 4.x does offer an embedded Cassandra server support with some >> utility classes like ScriptExecutor. It supports C* 2.2 current

Re: Recommendations for an embedded Cassandra and Unit Tests

2016-01-11 Thread Richard L. Burton III
illes 4.x does offer an embedded Cassandra server support with some > utility classes like ScriptExecutor. It supports C* 2.2 currently : > > https://github.com/doanduyhai/Achilles/wiki/CQL-embedded-cassandra-server > Le 11 janv. 2016 20:47, "Richard L. Burton III" a > écrit

Re: Recommendations for an embedded Cassandra and Unit Tests

2016-01-11 Thread DuyHai Doan
Achilles 4.x does offer an embedded Cassandra server support with some utility classes like ScriptExecutor. It supports C* 2.2 currently : https://github.com/doanduyhai/Achilles/wiki/CQL-embedded-cassandra-server Le 11 janv. 2016 20:47, "Richard L. Burton III" a écrit : > I

Recommendations for an embedded Cassandra and Unit Tests

2016-01-11 Thread Richard L. Burton III
I'm looking to see what's recommended for an embedded version of Cassandra, just for unit testing. I'm looking at https://github.com/jsevellec/cassandra-unit/wiki but I wanted to see if there's was a better recommendation? -- -Richard L. Burton III @rburton

Re: Embedded Cassandra Performance

2014-04-16 Thread Sávio Teles
n up to date alone (bug fixes and awesome new feature X!) > would make embedding worth it only for edge scenarios. I would recommend > against it. > > --- > Chris Lohfink > > On Apr 16, 2014, at 10:13 AM, Sávio Teles > wrote: > > Is it advisable to run the embedded Cassa

Re: Embedded Cassandra Performance

2014-04-16 Thread Chris Lohfink
uld recommend against it. --- Chris Lohfink On Apr 16, 2014, at 10:13 AM, Sávio Teles wrote: > Is it advisable to run the embedded Cassandra in production? > > > 2014-04-16 12:08 GMT-03:00 Sávio Teles : > I'm running a cluster with Cassandra and my app embedded. > > Regard

Re: Embedded Cassandra Performance

2014-04-16 Thread Sávio Teles
Is it advisable to run the embedded Cassandra in production? 2014-04-16 12:08 GMT-03:00 Sávio Teles : > I'm running a cluster with Cassandra and my app embedded. > > Regarding performance, it is better to run embedded Cassandra? > > What are the implications of running a

Embedded Cassandra Performance

2014-04-16 Thread Sávio Teles
I'm running a cluster with Cassandra and my app embedded. Regarding performance, it is better to run embedded Cassandra? What are the implications of running an embedded Cassandra ? Tks -- Atenciosamente, Sávio S. Teles de Oliveira voice: +55 62 9136 6996 http://br.linkedin.com/in/savio

Embedded Cassandra 1.2

2013-07-03 Thread Sávio Teles
We are using Cassandra 1.2 Embedded in a production environment. We are some issues with these lines: SocketAddress remoteSocket.get = socket (); assert socket! = null; ThriftClientState cState = activeSocketSessions.get (socket); The connection is maintained by remoteSocket thread. How

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-10-02 Thread aaron morton
Deleting the data may not be the right approach here if you want to have a clean slate to start the next test. It will leave tombstones around, which may reduce your performance if you make a lot of deletes. It's pedantic, but it's different to truncate or drop. Truncate is doing a few more th

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-30 Thread Roshan Dawrani
Hi, For our Grails + Cassandra application's clean-DB-for-every-test needs, we finally went back from using costly "truncate" calls to "range-scans-and-delete" approach, and found such a great different between the performance of the two approaches, that wrote a small blog post here about it: "Gra

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-23 Thread Roshan Dawrani
Thanks for sharing your inputs, Edward. Some comments inline below: On Thu, Sep 22, 2011 at 7:31 PM, Edward Capriolo wrote: > > >> 1) Should should try to dig in an determine why the truncate is slower. > Look for related jira issues on truncation. > I should give it a try. I thought I might get

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-22 Thread Edward Capriolo
On Thu, Sep 22, 2011 at 9:27 AM, Roshan Dawrani wrote: > Hi, > > We recently switched from Cassandra 0.7.2 to 0.8.5 and observing > considerable performance degradation in embedded server's response times > that we use in integration tests. > > One thing that we do is that we truncate our app colu

Performance degradation observed through embedded cassandra server - pointers needed

2011-09-22 Thread Roshan Dawrani
Hi, We recently switched from Cassandra 0.7.2 to 0.8.5 and observing considerable performance degradation in embedded server's response times that we use in integration tests. One thing that we do is that we truncate our app column families after each integration test so that the next one gets a

Solved: NoSuchMethodError with google guava/collections starting embedded cassandra service

2011-09-06 Thread David Hawthorne
I ran into this problem today. It's common enough that it shows up in google, but not common enough to have a documented resolution, so here's one. [junit] com.google.common.collect.ImmutableSet.copyOf(Ljava/util/Collection;)Lcom/google/common/collect/ImmutableSet; [junit] java.lang.NoS

Re: Embedded Cassandra server startup question

2011-01-21 Thread Anand Somani
It is a little slow not to the point where it concerns me (only have few tests for now), but keeps things very clean so no surprise effects. On Thu, Jan 20, 2011 at 6:33 PM, Roshan Dawrani wrote: > On Fri, Jan 21, 2011 at 5:14 AM, Anand Somani wrote: > >> Here is what worked for me, I use testN

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
Ok, got a Cassandra client from Hector and changed my clean-up to be truncate() based. Here is how I did it, if it could be any use to anyone: = HConnectionManager connectionManager = cassandraCluster.connectionManager Collection activePools = connectio

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
Back to square one on using CliMain/CliClient vs Cassandra/Hector API for cleanuup. It seems CliClient uses Antlr 3.1+ for parsing the statements passed to it, but I am using Grails that uses Antlr 2.7.7 (used by groovy code parsing), so I can't mix the two for programmatic use. Someone please te

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 8:56 AM, Roshan Dawrani wrote: > On Fri, Jan 21, 2011 at 8:52 AM, Maxim Potekhin wrote: > >> You can script the actions you need and pipe the file into Cassandra-CLI. >> Works for me. >> > > Probably CliMain / CliClient will help me there doing it as per your suggestion.

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 8:52 AM, Maxim Potekhin wrote: > You can script the actions you need and pipe the file into Cassandra-CLI. > Works for me. > Thanks Maxim, but first preference will be to do it through the API and not launch the Cassandra-CLI process with a scripted set of actions (I as

Re: Embedded Cassandra server startup question

2011-01-20 Thread Maxim Potekhin
You can script the actions you need and pipe the file into Cassandra-CLI. Works for me. On 1/20/2011 10:18 PM, Roshan Dawrani wrote: On Fri, Jan 21, 2011 at 8:07 AM, Aaron Morton > wrote: There is a truncate() function that will clear a CF. It may leave a

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 8:07 AM, Aaron Morton wrote: > There is a truncate() function that will clear a CF. It may leave a > snapshot around, cannot remember exactly. > Not sure if Hector (0.7.0-22) has added truncate() to its API yet. I can't find it. In Hector, I see a *dropColumnFamily()* tha

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 8:07 AM, Aaron Morton wrote: > There is a truncate() function that will clear a CF. It may leave a > snapshot around, cannot remember exactly. > > Or you could drop and recreate the keyspace between tests using > system_add_keyspace() and system_drop_keyspace(). The system

Re: Embedded Cassandra server startup question

2011-01-20 Thread Aaron Morton
There is a truncate() function that will clear a CF. It may leave a snapshot around, cannot remember exactly. Or you could drop and recreate the keyspace between tests using system_add_keyspace() and system_drop_keyspace(). The system tests in the test/system/__init__.py sort of do this. AaronOn 21

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 5:14 AM, Anand Somani wrote: > Here is what worked for me, I use testNg, and initialize and createschema > in the @BeforeClass for each test > >- In the @AfterClass, I had to drop schema, otherwise I was getting the >same exception. >- After this I started gett

Re: Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
On Fri, Jan 21, 2011 at 3:02 AM, Aaron Morton wrote: > Do you have a full error stack? > > That error is raised when the schema is added to an internal static map. > There is a lot of static state so it's probably going to make your life > easier if you can avoid reusing the JVM. > > Hi Aaron, Ac

Re: Embedded Cassandra server startup question

2011-01-20 Thread Anand Somani
he Spring application context gets built. > > When I run my Grails app test suite - it first runs the integration and > then functional test suite and it builds the application text individually > for each phase. > > When it brings the up the embedded Cassandra server in 2nd pha

Re: Embedded Cassandra server startup question

2011-01-20 Thread Aaron Morton
> embedded server when the Spring application context gets built. > > When I run my Grails app test suite - it first runs the integration and then > functional test suite and it builds the application text individually for > each phase. > > When it brings the up the emb

Embedded Cassandra server startup question

2011-01-20 Thread Roshan Dawrani
phase. When it brings the up the embedded Cassandra server in 2nd phase (for functional tests), it fails saying "*Attempt to assign id to existing column family.*" Anyone familiar with this error? Is it because both the test phases are executed in the same JVM instance and there is some

Re: Embedded Cassandra in JBoss

2010-09-15 Thread Gary Dusbabek
On Wed, Sep 15, 2010 at 09:17, Sandor Molnar wrote: > Hello guys! > > I just started researching today whether we can use Cassandra in our software > or not and I need to know if it is possible to use embedded Cassandra in > Jboss somehow. I googled it and I found several pa

Embedded Cassandra in JBoss

2010-09-15 Thread Sandor Molnar
Hello guys! I just started researching today whether we can use Cassandra in our software or not and I need to know if it is possible to use embedded Cassandra in Jboss somehow. I googled it and I found several pages like http://wiki.apache.org/cassandra/StorageProxy http://wiki.apache.org

Re: Embedded Cassandra for Integration testing

2010-03-14 Thread Ran Tavory
I have a writeup just for that from a while ago http://prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-service/ This addresses version 0.5.0, not 0.6 but I believe the diff isn't that big. And as mentioned, you may also browse hector to get the list of dependencies. Please also see http:

Re: Embedded Cassandra for Integration testing

2010-03-14 Thread Ryan Daum
Thanks Tom; I am working with 0.6 beta2 now, so not immediately applicable, but this is helpful. Maybe we ought to consider taking what you've done and putting it up in a generic way accessible on a public repo. R On Sun, Mar 14, 2010 at 2:16 PM, Tom Chen wrote: > Hi Ryan, > > I have been runn

Re: Embedded Cassandra for Integration testing

2010-03-14 Thread Jonas Bonér
Here is an util class from the Akka test suite, embedding Cassandra: import org.apache.cassandra.service.CassandraDaemon object EmbeddedCassandraService { System.setProperty("storage-config", "src/test/resources"); val cassandra = new Runnable { val cassandraDaemon = new CassandraDaemon

Re: Embedded Cassandra for Integration testing

2010-03-14 Thread Tom Chen
Hi Ryan, I have been running some tests locally, and I've been using. http://github.com/rantav/hector If you look at the pom.xml you can get a pretty good idea of the dependencies required to run a cassandra client for version 5. I usually combine it with the maven one jar to create one jar file

Embedded Cassandra for Integration testing

2010-03-14 Thread Ryan Daum
I know people have been successful embedding Cassandra, and I've seen code for how to bootstrap it, but I'm wondering what people have done to manage its 3rd party dependencies at build time? Especially for Maven projects, Cassandra is highly uncooperative as a dependency, as many of its 3rd party