Cassandra DSC installation fail due to some python dependecies. How to rectify ?

I am trying to install cassandra dsc20 but the installation fails due to some python dependecies. How could I make this work ? root@server1:~# sudo apt-get install dsc20 Reading package lists... Done Building dependency tree Reading state information... Done The following extra packages will be i

Re: How do I upgrade a single cassandra node in production to 3 nodes cluster ?

, >> >> It's not so much upgrading, but simply adding more nodes to your existing >> setup. >> >> Cheers, >> Erick >> >> >> On Sun, Feb 16, 2014 at 2:13 PM, Ertio Lew wrote: >> >>> I started off with a single cassandra node on

How do I upgrade a single cassandra node in production to 3 nodes cluster ?

I started off with a single cassandra node on my 2GB digital ocean VPS, but now I'm planning to upgrade it to 3 node cluster. My single node contain around 10 GB data spread across 10-12 column families. What should be the strategy to upgrade that to 3 node cluster, bearing in mind that my data re

Cassandra consuming too much memory in ubuntu as compared to within windows, same machine.

I run a development Cassandra single node server on both ubuntu & windows 8 on my dual boot 4GB(RAM) machine. I see that cassandra runs fine under windows without any crashes or OOMs however in ubuntu on same machine, it always gives an OOM message *$* *sudo service cassandra start* xss = -ea -j

Re: Why Solandra stores Solr data in Cassandra ? Isn't solr complete solution ?

Yes, what is Solr Cloud then for, that already provides clustering support, so what's the need for Cassandra ? On Tue, Oct 1, 2013 at 2:06 AM, Sávio Teles wrote: > > Solr's index sitting on a single machine, even if that single machine can >> vertically scale, is a single point of failure. >> >

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

ta. >> >> A >> >> - >> Aaron Morton >> New Zealand >> @aaronmorton >> >> Co-Founder & Principal Consultant >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> On 30/09/2013, at 9:58 PM

Why Solandra stores Solr data in Cassandra ? Isn't solr complete solution ?

Solr's data is stored on the file system as a set of index files[ http://stackoverflow.com/a/7685579/530153]. Then why do we need anything like Solandra or DataStax Enterprise Search? Isn't Solr complete solution in itself ? What do we need to integrate with Cassandra ?

Re: Among Datastax community & Cassandra debian package, which to choose for production install ?

30, 2013 at 6:04 PM, Ken Hancock wrote: > OpsCenter should be a separate package as you would only install it on a > single node, not necessarily even one that is running Cassandra. > > > > > On Sat, Sep 28, 2013 at 2:12 PM, Ertio Lew wrote: > >> I think both provide t

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

.) >> > Above > > Hope that helps. > > > - > Aaron Morton > New Zealand > @aaronmorton > > Co-Founder & Principal Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > On 27/09/2013, at 11:01 PM, Ertio Lew wrote:

Among Datastax community & Cassandra debian package, which to choose for production install ?

I think both provide the same thing except Datastax Community also provides some extras like Opscenter, etc. But I cannot find opscenter installed when I installled DSC on ubuntu. Although on windows installation, I saw opscenter & JRE as well , so I think for DSC, there is no such prerequisite for

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

I am not sure if I should use datastax's DSC or official Debian packages from Cassandra. How do I choose between them for a production server ? On Fri, Sep 27, 2013 at 11:02 AM, Ertio Lew wrote: > > Could you please clarify that: > 1. when I upgrade to a newer version, would

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

ommand) to upgrade ? 4. when should I prefer datastax's dsc to that ? (I need to install for production env.) On Fri, Sep 27, 2013 at 12:50 AM, Robert Coli wrote: > On Thu, Sep 26, 2013 at 12:05 PM, Ertio Lew wrote: > >> How do you install Cassandra on Ubuntu &am

What is the best way to install & upgrade Cassandra on Ubuntu ?

How do you install Cassandra on Ubuntu & later how do you upgrade the installation on the node when an update has arrived ? Do you simply download & replace the latest tar.gz, untar it to replace the older cassandra files? How do you do it ? How does this upgrade process differ for a major version

Why don't you start off with a “single & small” Cassandra server as you usually do it with MySQL?

For any website just starting out, the load initially is minimal & grows with a slow pace initially. People usually start with their MySQL based sites with a single server(***that too a VPS not a dedicated server) running as both app server as well as DB server & usually get too far with this setup

Maintain backup for single node cluster

I would like to have a single node cassandra cluster initially but to maintain backups for single node how about occasionally & temporarily adding a second node (one that would contain the backup, this could be my dev machine as well, far far from first node in some remote datacenter) to cluster a

Re: CustomTThreadPoolServer.java: Error occurred during processing of message.

Running Cassandra (1.0.0 final) single node with default configurations on Windows dev machine. Using Hector. On Thu, Aug 29, 2013 at 10:50 PM, Ertio Lew wrote: > I suddenly started to encounter this weird issue after writing some data > to Cassandra. Didn't know exactly what

CustomTThreadPoolServer.java: Error occurred during processing of message.

I suddenly started to encounter this weird issue after writing some data to Cassandra. Didn't know exactly what was written before this or due to which this started happening. ERROR [pool-2-thread-30] 2013-08-29 19:55:24,778 CustomTThreadPoolServer.java (line 205) Error occurred during processin

Re: Which of these VPS configurations would perform better for Cassandra ?

Amazon seems to much overprice its services. If you look out for a similar size deployment elsewhere like linode or digital ocean(very competitive pricing), you'll notice huge differences. Ok, some services & features are extra but may we all don't need them necessarily & when you can host on non-d

Re: Which of these VPS configurations would perform better for Cassandra ?

ow you configure your > system. That said, I would use xen before KVM for high-performance IO. > > I have not run Cassandra in any volume on Amazon -- lots of folks have, > and may have recommendations (including SSD) there for where it falls on > the price/performance curve. > &

Which of these VPS configurations would perform better for Cassandra ?

I am building a cluster(initially starting with a 2-3 nodes cluster). I have came across two seemingly good options for hosting, Linode & Digital Ocean. VPS configuration for both listed below: Linode:- -- XEN Virtualization 2 GB RAM 8 cores CPU (2x priority) (8 processor Xen inst

Re:

tant > New Zealand > > @aaronmorton > http://www.thelastpickle.com > > On 18/04/2013, at 3:21 PM, Ertio Lew wrote: > > > I run cassandra on single win 8 machine for development needs. > Everything has been working fine for several months but just today I saw >

[no subject]

I run cassandra on single win 8 machine for development needs. Everything has been working fine for several months but just today I saw this error message in cassandra logs & all host pools were marked down. ERROR 08:40:42,684 Error occurred during processing of message. java.lang.StringIndexOu

Re: Seeking Schema guidance

Thoughts ? On Tue, Nov 6, 2012 at 3:58 AM, Ertio Lew wrote: > I need to store (1)posts written by users, (2)along with activity data by > other users on these posts & (3) some counters for each post like views > counts, likes counts, etc. So for each post, there is 3 cat

Re: Is it bad putting columns with composite or integer name in CF with ByteType comparator & validator ?

Thoughts, please ? On Thu, Nov 1, 2012 at 7:12 PM, Ertio Lew wrote: > Would that do any harm or are there any downsides, if I store columns with > composite names or Integer type names in a column family with bytesType > comparator & validator. I have observed that bytesType com

Re: Option for ordering columns by timestamp in CF

rote: >> > You probably already know this but I'm pretty sure it wouldn't be a >> trivial >> > change, since to efficiently lookup a column by name requires the >> columns to >> > be ordered by name. A separate index would be needed in order to pro

Re: Option for ordering columns by timestamp in CF

y confusing) manner. So, > if you want to open a ticket, I would suggest framing it as "make column > timestamps optional". > > > On Wed, Oct 10, 2012 at 4:44 AM, Ertio Lew wrote: > >> I think Cassandra should provide an configurable option on per column >> f

Re: Option for ordering columns by timestamp in CF

I think Cassandra should provide an configurable option on per column family basis to do columns sorting by time-stamp rather than column names. This would be really helpful to maintain time-sorted columns without using up the column name as time-stamps which might otherwise be used to store most r

Re: RF on per column family basis ?

I heard that it is* not highly recommended* to create more than a single keyspace for an application or on a single cluster !? Moreover I fail to understand that why Cassandra puts this limitation to set RF on keyspace when, I guess, it makes more sense to do this on per CF basis !?

Re: Schema advice: (Single row or multiple row!?) How do I store millions of columns when I need to read a set of around 500 columns at a single read query using column names ?

I want to read columns for a randomly selected list of userIds(completely random). I fetch the data using userIds(which would be used as column names in case of single row or as rowkeys incase of 1 row for each user) for a selected list of users. Assume that the application knows the list of userId

Re: Schema advice: (Single row or multiple row!?) How do I store millions of columns when I need to read a set of around 500 columns at a single read query using column names ?

For each user in my application, I want to store a *value* that is queried by using the userId. So there is going to be one column for each user (userId as col Name & *value* as col Value). Now I want to store these columns such that can efficiently read columns for atleast 300-500 users in a sin

Re: Schema advice: (Single row or multiple row!?) How do I store millions of columns when I need to read a set of around 500 columns at a single read query using column names ?

Actually these columns are 1 for each entity in my application & I need to query at any time columns for a list of 300-500 entities in one go.

Schema advice: (Single row or multiple row!?) How do I store millions of columns when I need to read a set of around 500 columns at a single read query using column names ?

I want to store hundred of millions of columns(containing id1 to id2 mappings) in the DB & at any single time, retrieve a set of about 200-500 columns based on the column names(id1) if they are in single row or using rowkeys if each column is stored in a unique row. If I put them in a single row:

Re: How do I add a custom comparator class to a cassandra cluster ?

Williams wrote: > On Mon, May 14, 2012 at 1:11 PM, Ertio Lew wrote: > > I need to add a custom comparator to a cluster, to sort columns in a > certain > > customized fashion. How do I add the class to the cluster ? > > I highly recommend against doing this, because you&#

Re: How do I add a custom comparator class to a cassandra cluster ?

the lib directory and perform a rolling > restart of the nodes. > > On 5/14/12 11:11 AM, Ertio Lew wrote: > > I need to add a custom comparator to a cluster, to sort columns in a > certain customized fashion. How do I add the class to the cluster ? > > >

How do I add a custom comparator class to a cassandra cluster ?

I need to add a custom comparator to a cluster, to sort columns in a certain customized fashion. How do I add the class to the cluster ?

How to make the search by columns in range case insensitive ?

I need to make a search by names index using entity names as column names in a row. This data is split in several rows using the first 3 character of entity name as row key & the remaining part as column name & col value contains entity id. But there is a problem, I m storing this data in a CF usi

Re: Schema advice/help

-secondary-index-patterns/ >> >> >> >> >> On Tue, Mar 27, 2012 at 10:10 AM, Guy Incognito wrote: >> >>> without the ability to do disjoint column slices, i would probably use 5 >>> different rows. >>> >>> userId:itemType ->

Schema advice/help

I need to store activities by each user, on 5 items types. I always want to read last 10 activities on each item type, by a user (ie, total activities to read at a time =50). I am wanting to store these activities in a single row for each user so that they can be retrieved in single row query, sin

Re: Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

ance Developer > @aaronmorton > http://www.thelastpickle.com > > On 25/03/2012, at 9:47 PM, Ertio Lew wrote: > > I have been writing rows to a CF all with integer(4 byte) keys. So my CF > contains rows with keys in the entire range from Integer.MIN_VALUE to > Integer.MAX_VALUE. > > Now I wa

Re: Fwd: information on cassandra

I guess 2 node cluster with RF=2 might also be a starting point. Isn't it ? Are there any issues with this ? On Sun, Mar 25, 2012 at 12:20 AM, samal wrote: > Cassandra has distributed architecture. So 1 node does not fit into it. > although it can used but you loose its benefits , ok if you are

Adding Long type rows to a CF containing Integer(32) type row keys, without overlapping ?

I have been writing rows to a CF all with integer(4 byte) keys. So my CF contains rows with keys in the entire range from Integer.MIN_VALUE to Integer.MAX_VALUE. Now I want to store Long type keys as well in this CF **without disturbing the integer keys. The range of Long type keys would be exclud

Re: Using cassandra at minimal expenditures

gt; 2. calculate 1/4 of RAM on your system and cap to 8192MB > 3. pick the larger value > > So how about to start with the default? You will need to monitor the > heap usage at first. > > 2012/2/29 Ertio Lew : > > Thanks, I think I don't need high consistency(as pe

Re: Using cassandra at minimal expenditures

Thanks, I think I don't need high consistency(as per my app requirements) so I might be fine with CL.ONE instead of quorum, so I think I'm probably going to be ok with a 2 node cluster initially.. Could you guys also recommend some minimum memory to start with ? Of course that would depend on my

Re: Using cassandra at minimal expenditures

hat is the minimum recommended cluster size to > start with*? > > IMHO 3 > http://thelastpickle.com/2011/06/13/Down-For-Me/ > > A > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 28/02/2012, at 8:17 AM,

Using cassandra at minimal expenditures

Hi I'm creating an networking site using cassandra. I am wanting to host this application but initially with the lowest possible resources & then slowly increasing the resources as per the service's demand & need. *1. *I am wandering *what is the minimum recommended cluster size to start with*? A

Re: Any tools like phpMyAdmin to see data stored in Cassandra ?

On Mon, Jan 30, 2012 at 7:16 AM, Frisch, Michael wrote: > OpsCenter? > > http://www.datastax.com/products/opscenter > > - Mike > > > I have tried Sebastien's phpmyAdmin For > Cassandra to > see the data stored in Cassandra in the same mann

Any tools like phpMyAdmin to see data stored in Cassandra ?

I have tried Sebastien's phpmyAdmin For Cassandra to see the data stored in Cassandra in the same manner as phpMyAdmin allows. But since it makes assumptions about the datatypes of the column name/column value & doesn't allow to configure the da

Re: Using 5-6 bytes for cassandra timestamps vs 8…

g). It's easy to see that in my case I achieve almost 50% storage > savings and at least 30%. But if the column in question contains more than > 20 bytes -- what's up with trying to save 2? > > Cheers > > Maxim > > > > On 1/18/2012 11:49 PM, Ertio Lew wro

Re: Using 5-6 bytes for cassandra timestamps vs 8…

I believe the timestamps *on per column basis* are only required until the compaction time after that it may also work if the timestamp range could be specified globally on per SST table basis. and thus the timestamps until compaction are only required to be measure the time from the initialization

Re: Composite column names: How much space do they occupy ?

the effective length of a ByteBuffer, as it is > perfectly > legit to have a byte buffer only use parts of it's underlying array. You > should use the remaining() method instead. > > -- > Sylvain > > On Mon, Jan 2, 2012 at 12:29 PM, Ertio Lew wrote: > > Sorry I forgot to t

Re: Composite column names: How much space do they occupy ?

- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 2/01/2012, at 6:25 PM, Ertio Lew wrote: > > I am storing composite column names which are made up of two integer > components. However I am shocked after seeing the

Composite column names: How much space do they occupy ?

I am storing composite column names which are made up of two integer components. However I am shocked after seeing the storage overhead of these. I just tried out a composite name (with single integer component): Composite composite = new Composite(); composite.addComponent(-1

Doubts related to composite type column names/values

With regard to the composite columns stuff in Cassandra, I have the following doubts : 1. What is the storage overhead of the composite type column names/values, and 2. what exactly is the difference between the DynamicComposite and Static Composite ?

Retreiving column by names Vs by range, which is more performant ?

Retrieving columns by names vs by range which is more performant , when you have the options to do both ?

Re: Second Cassandra users survey

Provide an option to sort columns by timestamp i.e, in the order they have been added to the row, with the facility to use any column names. On Wed, Nov 2, 2011 at 4:29 AM, Jonathan Ellis wrote: > Hi all, > > Two years ago I asked for Cassandra use cases and feature requests. > [1] The results

Re: Cassandra Cluster Admin - phpMyAdmin for Cassandra

Thanks so much SebWajam for this great piece of work! Is there a way to set a data type for displaying the column names/ values of a CF ? It seems that your project always uses String Serializer for any piece of data however most of the times in real world cases this is not true so can we anyhow

Re: Newbie question - fetching multiple columns of different datatypes and conversion from byte[]

Should the different datatype col values or names be first read as byte buffer & then converted to appropriate type using Hector's provided serializers api like the way shown below ? ByteBuffer bb; .. String s= StringSerializer.get().fromByteBuffer(bb); Or are there any better ways ?

ByteBuffer as an initial serializer to read columns with mixed datatypes ?

I have a mix of byte[] & Integer column names/ values within a CF rows. So should ByteBuffer be my initial choice for the serializer while making the read query to the database for the mixed datatypes & then I should retrieve the byte[] or Integer from ByteBuffer using the ByteBuffer api's getInt()

Re: Authentication setup

Hey, I'm too looking out for a similar thing. I guess this is a very common requirement & may be soon provided as built-in functionality packed with cassandra setup. Btw nice to see if someone has ideas about how to implement this for now. On Fri, Oct 21, 2011 at 6:53 PM, Alexander Konotop <

Using counters in 0.8

I am using Hector for a project & wanted to try out using counters with latest 0.8 v Cassandra. How do we work with counters in 0.8 version ? Any web-links to such examples are appreciated. Has Hector started to provide API for that ?

Columns values(integer) need frequent updates/ increments

Hi, I am working on a Question/Answers web app using Cassandra(consider very similar to StackOverflow sites). I need to built the reputation system for users on the application. This way the user's reputation increases when s/he answers correctly somebody's question. Thus if I keep the reputation

Is it possible to get just a count of the no of columns in a row, in efficient manner ?

Can I get just a count of the no of columns in a row without deserializing all columns in row? Or should the usage of a counter column be preferred that maintains the no of columns currently present in the row, for the situations when the total count value is most frequently used than reading the a

Re: Using a synchronized counter that keeps track of no of users on the application & using it to allot UserIds/ keys to the new users after sign up

red to that limit.. Should I go for it or still are there any other things to consider ? > > Aaron > > On 1/03/2011, at 4:41 AM, Ertio Lew wrote: > >> Hi Ryan, >> >> I am considering snowflake as an option for my usage with Cassandra >> for a distributed applica

Re: Using a synchronized counter that keeps track of no of users on the application & using it to allot UserIds/ keys to the new users after sign up

s the microsecond precision is not required to that much depth for my use case. Any kind of suggestions would be appreciated. Best Regards Ertio Lew On Fri, Feb 4, 2011 at 1:09 AM, Ryan King wrote: > You could also consider snowflake: > > http://github.com/twitter/snowflake > > whic

Re: Specifying row caching on per query basis ?

Is this under consideration for future releases ? or being thought about!? On Thu, Feb 10, 2011 at 12:56 AM, Jonathan Ellis wrote: > Currently there is not. > > On Wed, Feb 9, 2011 at 12:04 PM, Ertio Lew wrote: >> Is there any way to specify on per query basis(like

Specifying row caching on per query basis ?

Is there any way to specify on per query basis(like we specify the Consistency level), what rows be cached while you're reading them, from a row_cache enabled CF. I believe, this could lead to much more efficient use of the cache space!!( if you use same data for different features/ parts in your a

Re: Merging the rows of two column families(with similar attributes) into one ??

Thanks for adding up Benjamin! On Wed, Feb 9, 2011 at 1:40 AM, Benjamin Coverston wrote: > > > On 2/4/11 11:58 PM, Ertio Lew wrote: >> >> Yes, a disadvantage of more no. of CF in terms of memory utilization >> which I see is: - >> >> if some CF is writ

Re: Merging the rows of two column families(with similar attributes) into one ??

Thanks Tyler! I think I'll have to very carefully take into consideration all these factors before deciding upon how to split my data into CFs, as this cannot an objective answer. I am expecting around atleast 8 column families for my entire application, if I split the data strictly according to t

Re: Merging the rows of two column families(with similar attributes) into one ??

avily written and read. And if you try to make the thresholds for flush smaller then more compactions would be needed. On Sat, Feb 5, 2011 at 11:58 AM, Ertio Lew wrote: > Thanks Tyler ! > > I could not fully understand the reason why more no of column families > would mean more mem

Re: Merging the rows of two column families(with similar attributes) into one ??

Thanks Tyler ! I could not fully understand the reason why more no of column families would mean more memory.. if you have under control parameters like memtable_throughput & memtable_operations which are set per column family basis then you can directly control & adjust by splitting the memory sp

Merging the rows of two column families(with similar attributes) into one ??

I read somewhere that more no of column families is not a good idea as it consumes more memory and more compactions to occur & thus I am trying to reduce the no. of column families by adding the rows of other Column families(with similar attributes) as separate rows into one. I have two kinds of d

Re: Can a same key exists for two rows in two different column families without clashing ?

Thanks Stephen for the Great Explanation! On Wed, Feb 2, 2011 at 4:31 PM, Stephen Connolly < stephen.alan.conno...@gmail.com> wrote: > On 2 February 2011 10:03, Ertio Lew wrote: > > Can a same key exists for two rows in two different column families > without > > clash

Can a same key exists for two rows in two different column families without clashing ?

that they can, but I wanted to know if there may be any problems associated with this. Thanks. Ertio Lew

Re: Is it recommended to store two types of data (not related to each other but need to be retrieved together) in one super column family ?

Could someone please point me in right direction by commenting on the above ideas ? On Fri, Jan 28, 2011 at 11:50 PM, Ertio Lew wrote: > Hi, > > I have two kinds of data that I would like to fit in one super column > family; I am trying this, for the reasons of implementing fas

Is it recommended to store two types of data (not related to each other but need to be retrieved together) in one super column family ?

Hi, I have two kinds of data that I would like to fit in one super column family; I am trying this, for the reasons of implementing fast database retrievals by combining the data of two rows into just one row. First kind of data, in supercolumn family, is named with timeUUIDs as supercolumn names

Re: What is be the best possible client option available to a PHP developer for implementing an application ready for production environments ?

there. Also we would not like to lock ourselves with implementation in a language with a client option that has limitations that we can bear now but not necessarily in future. If anybody else has a better solution to this please let me know. Thank you all. Ertio Lew On Tue, Jan 18, 2011 at 2:

What is be the best possible client option available to a PHP developer for implementing an application ready for production environments ?

ation. Thanks. Ertio Lew P.S. In any case, if you suggest a client option please list any major implementations of that.

Re: Do you have a site in production environment with Cassandra? What client do you use?

what is the technology stack do you use? On 1/14/11, Ran Tavory wrote: > I use Hector, if that counts. .. > On Jan 14, 2011 7:25 PM, "Ertio Lew" wrote: >> Hey, >> >> If you have a site in production environment or considering so, what >> is the client th

Do you have a site in production environment with Cassandra? What client do you use?

Hey, If you have a site in production environment or considering so, what is the client that you use to interact with Cassandra. I know that there are several clients available out there according to the language you use but I would love to know what clients are being used widely in production env

Are you using Phpcassa for any application currently in production? or considering so ?

I need to choose one amongst several client options to work with Cassandra for a serious web application for production environments. I prefer to work with php but I am not sure what if phpcassa would be best choice if I am open to working with other other languages as well. Php developers normall