Re: ParNew (promotion failed)

2011/3/24 Erik Onnen > It's been about 7 months now but at the time G1 would regularly > segfault for me under load on Linux x64. I'd advise extra precautions > in testing and make sure you test with representative load. > Which java version do you use?

error connecting to cassandra 0.7.3

I am using cassandra-0.7.3 and thrift-0.0.5,I wrote a java client using thrift 0.0.5 when I try to connect to local cassandra server I get the following error ERROR com.bluekai.cassandra.validation.ValidationThread - Failed to connect to 127.0.0.1. org.apache.thrift.transport.TTransportException:

error connecting to cassandra 0.7.3

I am using the following code to create my client. tr = new TSocket(url, port); TProtocol proto = new TBinaryProtocol(tr); client = new Cassandra.Client(proto); client.set_keyspace(this.keyspace); I am getting the errors I mentioned below Thanks Anurag -- Forwarded message --

Re: error connecting to cassandra 0.7.3

and where is transport creation for your thrift interface? Cassandra 0.7 uses Framed transport as default 2011/3/24 Anurag Gujral > > I am using the following code to create my client. > > tr = new TSocket(url, port); > TProtocol proto = new TBinaryProtocol(tr); > client = new Cassandra.Client

Why disc access mode conf parameter deleted from yaml in cassandra 0.7 brunch,

mmap which will be set default on 64 bit platforms works badly (i don't know reason why this happens but this is happens on 4 machines in my case so i don't think that it is hardware problems)

Re: result of get_indexed_slices() seems wrong

Thanks aaron. Maybe we need to do more check at ThriftValidation.validateIndexClauses(), add this: Map colDefs = DatabaseDescriptor.getTableDefinition(keyspace).cfMetaData().get(columnFamily).getColumn_metadata(); for (IndexExpression expression : index_clause.expressions)

Configuration for large number of inserts

Hi, When doing bulk inserts of data using Pelops (~1000 million rows, column counts varying from 1 - 100,000 but more skewed towards fewer columns), we're ultimately getting a server OOME using 0.7.4. I've attempted to follow other pointers on this issue (reducing threshold before memtables flushe

Quorum, Hector, and datacenter preference

Hi - Our cluster is spread between 2 datacenters. We have a straight-forward IP assignment so that OldNetworkTopology (rackinferring snitch) works well.We have cassandra clients written in Hector in each of those data centers. The Hector clients all have a list of all cassandra nodes ac

Re: Sizing a Cassandra cluster

Thanks for the tips on the replication factor. Any thoughts on the number of nodes in a cluster to support an RF=3 with a workload of 400 ops/sec (4-8K sized rows, 50/50 read/write)? Based on the "sweet spot" hardware referenced in the wiki (8-core, 16-32GB RAM), what kink of ops/sec could I reas

Re: Quorum, Hector, and datacenter preference

Indeed I found the big flaw in my own logic. Even writing to the "local" cassandra nodes does not guarantee where the replicas will end up. The decision where to write the first replica is based on the token ring, which is spread out on all nodes regardless of datacenter. right ? On Mar 2

Column TTL Hook

Hi all, Is there any way for me to save or pass the columns retired by the column TTL? I understand that compaction takes care of removing expired columns, I would like to know the keys for which columns have expired. Thanks, -Orr

RE: Map-Reduce on top of cassandra

Worked like a charm! I have installed hadoop on my Cassandra nodes and ran the MR using Hadoop job tracker. A simple key count improved from ~2 hours to about 25 minutes (150M keys and ~100G on each node) Thanks Jeremy. -Original Message- From: Jeremy Hanna [mailto:jeremy.hanna1...@gma

Re: Quorum, Hector, and datacenter preference

We have a load balancing policy which selects the host best on latency and uses a Phi convict algorithm in a method similar to DynamicSnitch. Using this policy, you would inherently get the closest replica whenever possible as that would most likely be the best performing. This policy is still in

unsubscribe

Re: Why disc access mode conf parameter deleted from yaml in cassandra 0.7 brunch,

You can still set it, but it's removed from the example because every time we've seen someone change it, they were changing it because of confused ideas of how mmap works rather than actual performance problems. On Thu, Mar 24, 2011 at 4:27 AM, ruslan usifov wrote: > mmap which will be set defaul

unsubscribe

unsubscribe

Re: result of get_indexed_slices() seems wrong

it's unusual but valid to have an expression on a column w/ no metadata. 2011/3/24 Wangpei (Peter) : > Thanks aaron. > > Maybe we need to do more check at ThriftValidation.validateIndexClauses(), > add this: > > Map colDefs = > DatabaseDescriptor.getTableDefinition(keyspace).cfMetaData().g

Re: error connecting to cassandra 0.7.3

Hi Ruslan where is this framed transport defined. I did TProtocol proto = new TFramedTransport(tr); I am getting annot find symbol [javac] symbol : class TFramedTransport Please Suggest Thanks Anurag On Thu, Mar 24, 2011 at 2:13 AM, ruslan usifov wrote: > and where is transport creation for

Re: Column TTL Hook

No. On Thu, Mar 24, 2011 at 8:50 AM, Or Yanay wrote: > Hi all, > > Is there any way for me to save or pass the columns retired by the column > TTL? > > I understand that compaction takes care of removing expired columns, I would > like to know the keys for which columns have expired. > > > > Than

Re: Clearsnapshot Problem

Sounds good. I'll open a ticket. As far as the workaround goes I use: (a)Flush on the node, (b) copy the database files to backup location. I tested the backup files in my 3-node cluster (RF=3). (a).Took one node down(simulated crash. Ip, name key range stays the same). (b) Erased all keyspace fol

Re: error connecting to cassandra 0.7.3

Hi All, I am using the following code as per suggestion by Ruslan tr = new TSocket(url, port,timeout); TTransport transport= new TFramedTransport(tr); TProtocol proto = new TBinaryProtocol(transport); client = new Cassandra.Client(proto);

Re: unsubscribe

On Thu, Mar 24, 2011 at 9:11 AM, Mohamed Ibrahim wrote: > unsubscribe http://bit.ly/ho9zoY http://wiki.apache.org/cassandra/FAQ#unsubscribe

WriteMultiColumns just write one column ... amazing!

Hi all, I'm almost sure I'm just tired and I am doing something stupid however I can't understand this problem. In one Super Column Family I have just 2 rows, called ALL and INCREMENTAL. For some reason I sometimes need to duplicate a SuperColumn from the row ALL to the INCREMENTAL one ... very

Re: error connecting to cassandra 0.7.3

Hi All, I was able to resolve by making socket open. Thanks Anurag On Thu, Mar 24, 2011 at 7:48 AM, Anurag Gujral wrote: > Hi All, > I am using the following code as per suggestion by Ruslan >tr = new TSocket(url, port,timeout); >TTransport transport= new

Re: Re: Quorum, Hector, and datacenter preference

Hi Nate - That sounds really promising and I'm looking forward to trying that out. My original question came up while thinking how to achieve quorum (with rf=3) with a loss of 1 of 2 data centers. My logic was that if you had 2 replicas in the same data center where the client originally wri

access.properties

Hi ya, I'm few days into the Cassandra experience and this is my first message here :) I've set up a dev instance of Cassandra and have got logins and access working. Well, I thought I did, but I have found that my user that can add and remove column families, can not insert or get the rows. I r

Cassandra apt repository gives 403 forbidden

I'm having trouble accessing the apt repository. I get: W: Failed to fetch http://www.apache.org/dist/cassandra/debian/dists/unstable/main/binary-i386/Packages.gz 403 Forbidden Anyone else having the same problem?

R: WriteMultiColumns just write one column ... amazing!

I answer myself :) But i put the answer here maybe is useful for someone in future. The problem was in the Timestamp, if you "copy" a column from another row but you don't change the timestamp then it will be written only if in the past, a column with the same name (key) has not been erased after

Re: Cassandra apt repository gives 403 forbidden

https://issues.apache.org/jira/browse/CASSANDRA-2370 On Thu, Mar 24, 2011 at 11:53 AM, Luke Biddell wrote: > > I'm having trouble accessing the apt repository. > > I get: > > W: Failed to fetch > http://www.apache.org/dist/cassandra/debian/dists/unstable/main/binary-i386/Packages.gz > 403 Forbi

pig counting question

Hey all, I'm trying to run a very simple Pig script against my Cassandra cluster (5 nodes, 0.7.3). I've gotten it all set up and working, but the script is giving me some strange results. Here is my script: rows = LOAD 'cassandra://Keyspace/ColumnFamily' USING CassandraStorage(); rowct = FOREAC

Re: pig counting question

The limit defaults to 1024 but you can set it when you use CassandraStorage in pig, like so: rows = LOAD 'cassandra://Keyspace/ColumnFamily' USING CassandraStorage(4096); or whatever value you wish. Give that a try and see if it gives you more of what you're looking for. On Mar 24, 2011, at 1:16

Central monitoring of Cassandra cluster

Can someone share if they have centralized monitoring for all cassandra servers. With many nodes it becomes difficult to monitor them individually unless we can look at data in one place. I am looking at solutions where this can be done. Looking at Cacti currently but not sure how to integrate it w

Re: Central monitoring of Cassandra cluster

...in process of using nagios to monitor three servers. Will post updates shortly. Regards Vineet Daniel Cell : +918106217121 Websites : Blog | Linkedin | Twitter On Fri, Ma

RE: Central monitoring of Cassandra cluster

We have Collectd (http://www.collectd.org/) monitoring Cassandra via its Java/JMX plugin. Collectd feeds data to a central Graphite/Carbon (http://graphite.wikidot.com/start) instance via https://github.com/indygreg/collectd-carbon . With Graphite, you can effortlessly utilize the web UI (or HT

RE: Central monitoring of Cassandra cluster

We at Evident Software have ClearStone, a comprehensive JMX based monitoring solution for Cassandra (and other NoSQL technologies). You can get more details here http://www.evidentsoftware.com/products/clearstone-for-cassandra/. You should be able to connect to individual ndoes and also get an aggr

RE: Central monitoring of Cassandra cluster

Forgot to mention, you can use the product for free upto 10 Cassandra nodes. We want every developer to use this as much as they want. Prasanna -Original Message- From: Prasanna Jayapalan [mailto:pjayapa...@evidentsoftware.com] Sent: Thursday, March 24, 2011 3:31 PM To: user@cassandra.apa

Re: Re: Quorum, Hector, and datacenter preference

Doesn't CL=LOCAL_QUORUM solve your problem? On Thu, Mar 24, 2011 at 9:33 AM, wrote: > Hi Nate - > > That sounds really promising and I'm looking forward to trying that out. > > My original question came up while thinking how to achieve quorum (with > rf=3) with a loss of 1 of 2 data centers. My

Re: log4j settings inquiry

Just checking the obvious thing, are you running cassandra or cassandra.bat ? (cannot imagine you would even get as far as you did but I like asking questions). It's all a bit strange because the code in 0.7.4 will throw some errors if it cannot resolve a path to load the config from. You can

Re: Configuration for large number of inserts

With only 2Gb heap you are pushing things a little, see http://wiki.apache.org/cassandra/MemtableThresholds for guidelines on how to estimate the size. - turn off key and column caches - consider reducing the memtable ops, AFAIK throughput in MB calculates using the col values only. So if you

Option for ordering columns by timestamp in CF

Cassandra 0.7.4 Column names in my CF are of type byte[] but I want to order columns by timestamp. What is the best way to achieve this? Does it make sense for Cassandra to support ordering of columns by timestamp as option for a column family irrespective of the column name type? Thanks, Naren

Re: access.properties

Hi Hayden, What you are describing certainly seems useful. I am not aware of anyone using the security features of the SimpleAuthenticator anywhere in production. If you have a real world use case and would like to see the authenticator improved please open a JIRA ticket. If you have something

Re: Sizing a Cassandra cluster

Big old guess of something in the 1000's. Try benchmarking your work load and plug the numbers (my 5m is pretty high) in... - 8 cores * 8 writers per core = 64 if each write request takes 5ms = 1280 max per sec - 1 spindle * 16 readers per spindle = 16 readers if each read request takes 5ms

RE: pig counting question

It looks like this functionality is not in the 0.7.3 version of CassandraStorage. I tried to add the constructor which takes the limit to the class, but I ran into some Pig parsing errors, so I had to make the parameter a string. How did you get around this for the version of CassandraStorage in

Re: Central monitoring of Cassandra cluster

http://www.datastax.com/products/opscenter https://www.cloudkick.com/features/monitoring Aaron On 25 Mar 2011, at 08:36, Prasanna Jayapalan wrote: > Forgot to mention, you can use the product for free upto 10 Cassandra > nodes. We want every developer to use this as much as they want. > > Pras

Re: Sizing a Cassandra cluster

Aaron, How did you get to 1280 writes/sec? Counting 64 writers each taking 5ms for a write cycle, assuming real parallel access with no speed hits, I get 12,800 writes/sec. Am I missing something? From Jose's iPhone On Mar 24, 2011, at 2:52 PM, aaron morton wrote: > Big old guess of somethi

Re: Option for ordering columns by timestamp in CF

If you mean order by the column timestamp (as passed by the client) that it not possible. Can you use your own timestamps as the column name and store them as long values ? Aaron On 25 Mar 2011, at 09:30, Narendra Sharma wrote: > Cassandra 0.7.4 > Column names in my CF are of type byte[] bu

Re: Sizing a Cassandra cluster

Ops you're right, off by 10. should be 12,800 write and 3,200 read. Will also take the opportunity again to say this are just "some numbers" that may help when understanding how your app will behave when moving to new HW. And that there are a lot of other things the nodes have to do (like comp

Re: access.properties

Thanks for that Ben, Just to clarify: The current behavior is that if a user is given access to create and destroy column families, then they will be unable to edit/view any data in any column family they create unless they are also specifically given access to the new column family in the access

Add node to balanced cluster?

Hello Which strategy should i use to and new node to fully balanced cluster (nodes tokens are generated by python script: def tokens(nodes): for x in xrange(nodes): print 2 ** 127 / nodes * x tokens(3); ) How to get balanced cluster after adding ne node without big stress for current clus

Re: SSTable Corruption

Just accidently hard resetet a node running 0.7.2 (with some patches from 0.7.3) and had the same problem. I'm a little hesitating upgrading to 0.7.4 Can I always delete the Statistics.db without any data loss? Thibaut On Thu, Mar 24, 2011 at 1:37 AM, Brandon Williams wrote: > On Wed, Mar 23

Re: pig counting question

Hmmm, for wide rows, you can page it with I believe some changes on 0.7 branch that made it in as part of https://issues.apache.org/jira/browse/CASSANDRA-1618 recently. Specifically, using the 0.7 branch version of CassandraStorage, you can specify it using this basic template: cassandra:///[?s

Re: access.properties

Looking at the code I think your assumption is correct. When you choose the simple authority you have to explicitly set permissions. On 3/24/11 3:50 PM, Hayden Andrews wrote: Thanks for that Ben, Just to clarify: The current behavior is that if a user is given access to create and destroy col

Re: pig counting question

And if you download the 0.7 branch and build the cassandra_storage.jar in the contrib/pig section with that update, you should be able to use it with your 0.7.3 cluster. Those changes are typically independent of the Cassandra version. On Mar 24, 2011, at 5:49 PM, Jeremy Hanna wrote: > Hmmm,

Re: Error connection to remote JMX agent! on nodetool

Hi Aaron Thank you so much for your reply and advice. I did describe cluster. Then I found multiple version as following. [default@unknown] describe cluster; Cluster Information: Snitch: org.apache.cassandra.locator.SimpleSnitch Partitioner: org.apache.cassandra.dht.RandomPartitioner Sc

Re: Error connection to remote JMX agent! on nodetool

Simple solution is to stop the nodes and delete the contents of the commitlog, data and saved_caches directories. Normally these are in /var/lib/cassandra This will give you a clean starting point. The cli statement is using secondary indexes http://www.datastax.com/dev/blog/whats-new-cassand

Re: Add node to balanced cluster?

http://wiki.apache.org/cassandra/Operations On Thu, Mar 24, 2011 at 5:15 PM, ruslan usifov wrote: > Hello > > Which strategy should i use to and new node to fully balanced cluster (nodes > tokens are generated by python script: > > def tokens(nodes): >   for x in xrange(nodes): >     print 2 ** 1

URGENT HELP PLEASE!

Hello all, I'm running 2 Cassandra 6.5 nodes and I brought down the secondary node and restarted the primary node. After Cassandra came back up all data has been reverted to several months ago. I could really use some incite here, this is a production website and I need to act quickly. I have a

Re: Add node to balanced cluster?

Also: http://www.datastax.com/docs/0.7/operations/clustering#adding-capacity On Thu, Mar 24, 2011 at 5:20 PM, Jonathan Ellis wrote: > http://wiki.apache.org/cassandra/Operations > > On Thu, Mar 24, 2011 at 5:15 PM, ruslan usifov > wrote: > > Hello > > > > Which strategy should i use to and new

OOM during compaction with half the heap still available?

Hey All, I've noticed that the Cassandra instance I have running on our build machine occasionally crashes with an OOM error during compaction. I'm going to dial down the memtable thresholds etc but I was wondering if anyone could help explain the heap usage at the time of the crash. I just happ

Re: URGENT HELP PLEASE!

Was there anything in the server logs during startup ? I've not heard of this happening before and it's hard think of how / why cassandra could revert it's data. Other than something external playing with the files on disk Aaron On 25 Mar 2011, at 13:49, Jared Laprise wrote: > Hello all, I’m

Re: log4j settings inquiry

specifying the path using the file:// protocol worked like a charm. thank you very much Aaron for your help. but i was wondering why -Dlog4j.configuration=log4j-server.properties didn't work and -Dlog4j.configuration=file://"C:\Program Files\Apache Software Foundation\apache-cassandra-0.7.4\conf

Re: log4j settings inquiry

we've had issues in the past w/ the .bat file not quoting paths, which you need to do to support paths w/ spaces. can you open a ticket and we'll fix this one too? On Thu, Mar 24, 2011 at 9:29 PM, david lee wrote: > specifying the path using the file:// protocol worked like a charm. > thank you

Re: URGENT HELP PLEASE!

Right, Cassandra doesn't keep old versions around so to see an old version you have to have uncompacted data and whack the new data -- either by blowing away sstables or not replaying the commitlog. Snapshots flush before creating their hard links, which rules out any commitlog problems. If you r

Re: OOM during compaction with half the heap still available?

Have you run nodetool scrub? The data versioning problem scrub fixes can manifest itself as trying to read GB of data into memory during compaction. On Thu, Mar 24, 2011 at 8:52 PM, Dan Washusen wrote: > Hey All, > I've noticed that the Cassandra instance I have running on our build machine > oc

Re: SSTable Corruption

Yes, Statistics is convenient because as part of supporting old 0.6 data Cassandra will just build it if it's not there. Technically you can rebuild filter and index too but it's not automatic. It looks like when we added statistics we didn't make sure to fsync it when we fsync the other componen

RE: URGENT HELP PLEASE!

Thanks for the responses. I got everything working again, and have some ideas on why but am not completely sure. How I got it working again was simply bring the second node back online. I was under the assumption that all data is replicated between nodes (eventually). Am I incorrect? It would s

Re: error connecting to cassandra 0.7.3

I highly recommend using one of the existing Cassandra clientsinstead of writing your own. On Thu, Mar 24, 2011 at 10:17 AM, Anurag Gujral wrote: > Hi All, >I was able to resolve by making socket open. > Thanks > Anurag > > > On Thu, Mar

Re: URGENT HELP PLEASE!

Hi Jared, Sounds like you have two nodes in the cluster. What is your replication factor set to? 1? 2? Have you ever run repair? What consistency level do you use for reads and writes? From the way you are speaking it sounds like you are sending all of your traffic to a single node (primar

is it possible to mutate Columns and CounterColumn in the same batch mutation?

Hi folks, I'm modeling the partitioned counters into Hector and given the non-inheritance of Thrift, I don't see how to add a ColumnCounter and a Column in the same batch mutation. Is it possible do achieve? or are both in fact different mutations? Thanks

Re: OOM during compaction with half the heap still available?

Ah, it would appear I forgot to do that on the hudson machine. Thanks! -- Dan Washusen On Friday, 25 March 2011 at 2:23 PM, Jonathan Ellis wrote: > Have you run nodetool scrub? The data versioning problem scrub fixes > can manifest itself as trying to read GB of data into memory during > compact

Re: URGENT HELP PLEASE!

Each row is replicated to replication_factor nodes, not the entire cluster (or you couldn't scale writes by adding machines). Sounds like you're running with RF=1. On Thu, Mar 24, 2011 at 10:44 PM, Jared Laprise wrote: > Thanks for the responses. I got everything working again, and have some ide

Re: is it possible to mutate Columns and CounterColumn in the same batch mutation?

You can't have them both in the same Mutation struct, but you can have them in the map>> that is the "batch." 2011/3/24 Patricio Echagüe : > Hi folks, I'm modeling the partitioned counters into Hector and given the > non-inheritance of Thrift, I don't see how to add a ColumnCounter and a > Column

RE: URGENT HELP PLEASE!

My replication factor is 1 I haven't run repair until today, I'm using ONE for consistency level. I have two servers that are load balanced (per session) which both run Cassandra and each server connects to Cassandra on localhost. Based on what you're saying, and being I'm using session (cookie

cassandra client sample code for 0.7.3

I am in need of sample code(basically cassandra client) in java using batch_mutate If someone has please reply back Thanks Anurag

RE: URGENT HELP PLEASE!

Correct, replication factor of 1. I've been reading and researching as fast as possible so I'm also starting to realize what some of the configurations actually mean and getting a clearer picture. My request to the Cassandra community was a desperate, "Oh man! I F'd up!" moment, and didn't hav

Re: URGENT HELP PLEASE!

On Thu, Mar 24, 2011 at 11:58 PM, Jared Laprise wrote: > My replication factor is 1 > Then you are living dangerously. > I haven't run repair until today, I'm using ONE for consistency level. > Repair at rf=1 won't do anything. I have two servers that are load balanced (per session) which bo

Index name is not optional in Cassandra 0.7.4?

Hi all, I'm using Hector 0.7.0-28 to access Cassandra. On Cassandra 0.7.0 when I'm trying to create new column family with indexes, I create it without specifying the indexName(String). But I found that the code does not work in Cassandra 0.7.4. It breaks by throwing an InvalidRequestException

Re: Central monitoring of Cassandra cluster

Cacti and Munin are great for graphing, nagios is good for monitoring. I wrote a very simple JMX proxy that you can send a request to and it retrieves the desired JMX beans. there are jmx proxys out there if you don't want to write your own, for example http://code.google.com/p/polarrose-jmx-re