RE: Problem while streaming SSTables with BulkOutputFormat

2012-10-11 Thread Ralph Romanos
Hello again, I noticed that this issue happens whenever a reduce task is done (so the SSTable is generated) while an SSTable already generated is being streamed to the cluster. I think that the error is therefore caused because cassandra cannot queue SSTables that are streamed to the cluster.Do

Re: 1.1.1 is "repair" still needed ?

2012-10-11 Thread Watanabe Maki
Even if HH works fine, HH will not be created until the failure detector marks the node is dead. HH will not be created for partially timeouted mutation request ( but meets CL ) also... In my understanding... On 2012/10/11, at 5:55, Rob Coli wrote: > On Tue, Oct 9, 2012 at 12:56 PM, Oleg Du

Create column family with Composite key column via thrift API

2012-10-11 Thread Vivek Mishra
Hi, I know one way is to execute cql query via thrift client to create a column family having compound primary/composite columns. But is it the only way? Looks like i would end up creating own "CQLTranslator/Wrapper" to deal with compound primary/composite columns!(Or may be something else in n

CQL Sets and Maps

2012-10-11 Thread Hiller, Dean
I was reading Brian's post http://mail-archives.apache.org/mod_mbox/cassandra-dev/201210.mbox/%3ccajhhpg20rrcajqjdnf8sf7wnhblo6j+aofksgbxyxwcoocg...@mail.gmail.com%3E In which he asks > Any insight into why CQL puts that in column name? > Where does it store the metadata related to compound key

unsubscribe

2012-10-11 Thread Chris Favero
unsubscribe

cassandra + pig

2012-10-11 Thread William Oberman
I'm wondering how many people are using cassandra + pig out there? I recently went through the effort of validating things at a much higher level than I previously did(*), and found a few issues: https://issues.apache.org/jira/browse/CASSANDRA-4748 https://issues.apache.org/jira/browse/CASSANDRA-4

Re: 1.1.1 is "repair" still needed ?

2012-10-11 Thread B. Todd Burruss
as of 1.0 (CASSANDRA-2034) hints are generated for nodes that timeout. On Thu, Oct 11, 2012 at 3:55 AM, Watanabe Maki wrote: > Even if HH works fine, HH will not be created until the failure detector > marks the node is dead. > HH will not be created for partially timeouted mutation request ( b

Re: cassandra + pig

2012-10-11 Thread Jeremy Hanna
The Dachis Group (where I just came from, now at DataStax) uses pig with cassandra for a lot of things. However, we weren't using the widerow implementation yet since wide row support is new to 1.1.x and we were on 0.7, then 0.8, then 1.0.x. I think since it's new to 1.1's hadoop support, it s

Re: cassandra + pig

2012-10-11 Thread William Oberman
If you don't mind me asking, how are you handling the fact that pre-widerow you are only getting a static number of columns per key (default 1024)? Or am I not understanding the "limit" concept? On Thu, Oct 11, 2012 at 11:25 AM, Jeremy Hanna wrote: > The Dachis Group (where I just came from, now

unnecessary tombstone's transmission during repair process

2012-10-11 Thread Alexey Zotov
Hi Guys, I have a question about merkle tree construction and repair process. When mercle tree is constructing it calculates hashes. For DeletedColumn it calculates hash using value. Value of DeletedColumn is a serialized local deletion time. We know that local deletion time can be different on di

Re: can't get cqlsh running

2012-10-11 Thread Nick Bailey
It looks like easy_install is only recognizing python2.4 on your system. It is installing the cql module for that version. The cqlsh script explicitly looks for and runs with python2.6 since 2.4 isn't supported. I believe you can run 'python2.6 easy_install cql' to force it to use that python inst

Re: cassandra + pig

2012-10-11 Thread Jeremy Hanna
For our use case, we had a lot of narrow column families and the couple of column families that had wide rows, we did our own paging through them. I don't recall if we did paging in pig or mapreduce but you should be able to do that in both since pig allows you to specify the slice start. On O

Re: cassandra + pig

2012-10-11 Thread William Oberman
Thanks Jeremy! Maybe figuring out how to do paging in pig would have been easier, but I found the widerow setting first which led me where I am today. I don't mind helping to blaze trails, or contribute back when doing so, but I usually try to follow rather than lead when it comes to tools/softwa

unsubscribe

2012-10-11 Thread Siddiqui, Akmal
unsubscribe

Re: unnecessary tombstone's transmission during repair process

2012-10-11 Thread Rob Coli
On Thu, Oct 11, 2012 at 8:41 AM, Alexey Zotov wrote: > Value of DeletedColumn is a serialized local > deletion time. We know that local deletion time can be different on > different nodes for the same tombstone. So hashes of the same tombstone on > different nodes will be different. Is it true? Y

Re: unnecessary tombstone's transmission during repair process

2012-10-11 Thread Sylvain Lebresne
> I have a question about merkle tree construction and repair process. When > mercle tree is constructing it calculates hashes. For DeletedColumn it > calculates hash using value. Value of DeletedColumn is a serialized local > deletion time. The deletion time time is not local to each replica, it'

Re: cassandra 1.0.8 memory usage

2012-10-11 Thread Jason Wee
what jvm version? On Thu, Oct 11, 2012 at 2:04 PM, Daniel Woo wrote: > Hi guys, > > I am running a mini cluster with 6 nodes, recently we see very frequent > ParNewGC on two nodes. It takes 200 - 800 ms on average, sometimes it takes > 5 seconds. You know, hte ParNewGC is stop-of-wolrd GC and ou

Re: cassandra 1.0.8 memory usage

2012-10-11 Thread Rob Coli
On Wed, Oct 10, 2012 at 11:04 PM, Daniel Woo wrote: > I am running a mini cluster with 6 nodes, recently we see very frequent > ParNewGC on two nodes. It takes 200 - 800 ms on average, sometimes it takes > 5 seconds. You know, hte ParNewGC is stop-of-wolrd GC and our client throws > SocketTimeoutE

Re: cassandra 1.0.8 memory usage

2012-10-11 Thread Rob Coli
On Thu, Oct 11, 2012 at 11:02 AM, Rob Coli wrote: > On Wed, Oct 10, 2012 at 11:04 PM, Daniel Woo wrote: > We did not see any swap usage during the GC, any idea about this? As an aside.. you shouldn't have swap enabled on a Cassandra node, generally. As a simple example, if you have swap enabled

Perlcassa - Perl Cassandra 'Client'

2012-10-11 Thread Michael Kjellman
Hi- A few months back I wrote a Perl client for Cassandra and I realized I never sent it out to this list. While I realize that while Perl is not the language du jour hopefully this will help someone else out. :) Code is periodically thrown up on CPAN but look at http://github.com/mkjellman/per

Re: [problem with OOM in nodes]

2012-10-11 Thread Hiller, Dean
"Splitting one report to multiple rows is uncomfortably" WHY? Reading from N disks is way faster than reading from 1 disk. I think in terms of PlayOrm and then explain the model you can use so I think in objects first Report { String uniqueId String reportName; //may be indexable and query

CRM:0267190

2012-10-11 Thread Joseph Heinzen
unsubscribe Joseph Heinzen Senior VP, UCC Sales Tel. 571-297-4162 | Mobile. 703-463-7145 Fax. 703-891-1073 | jhein...@microtech.net | www.MicroTech.net [Description: C:\Users\joseph.heinzen\AppData\Roaming\Microsoft\Signatures\New Email Si

Re: can't get cqlsh running

2012-10-11 Thread Tim Dunphy
> > > I believe you can run 'python2.6 easy_install cql' to force it to use > that python install. > Well initially I tried going: [root@beta:~] #python2.6 easy_install python2.6: can't open file 'easy_install': [Errno 2] No such file or directory But when I used the full paths of each: /usr/bi

Re: CRM:0267190

2012-10-11 Thread Michael Shuler
On 10/11/2012 02:37 PM, Joseph Heinzen wrote: > unsubscribe http://wiki.apache.org/cassandra/FAQ#unsubscribe > *Joseph Heinzen* > Senior VP, UCC Sales > Tel. 571-297-4162 | Mobile. 703-463-7145 > Fax. 703-891-1073 | _jhein...@microtech.net > _ | _www.MicroTech.net

Re: unsubscribe

2012-10-11 Thread Tyler Hobbs
http://wiki.apache.org/cassandra/FAQ#unsubscribe On Thu, Oct 11, 2012 at 12:41 PM, Siddiqui, Akmal < akmal.siddi...@broadvision.com> wrote: > unsubscribe > -- Tyler Hobbs DataStax

Re: READ messages dropped

2012-10-11 Thread Tyler Hobbs
On Wed, Oct 10, 2012 at 3:10 PM, Tamar Fraenkel wrote: > > What I did noticed while looking at the logs (which are also running > OpsCenter), is that there is some correlation between the dropped reads and > flushes of OpsCenter column families to disk and or compactions. What are > the rollups C

Re: Option for ordering columns by timestamp in CF

2012-10-11 Thread Tyler Hobbs
Without thinking too deeply about it, this is basically equivalent to disabling timestamps for a column family and using timestamps for column names, though in a very indirect (and potentially confusing) manner. So, if you want to open a ticket, I would suggest framing it as "make column timestamp

RE: unsubscribe

2012-10-11 Thread Siddiqui, Akmal
http://wiki.apache.org/cassandra/FAQ#unsubscribe -Original Message- From: Chris Favero [mailto:chris.fav...@tricast.com] Sent: Thursday, October 11, 2012 7:37 AM To: user@cassandra.apache.org Subject: unsubscribe unsubscribe

RE: unsubscribe

2012-10-11 Thread Siddiqui, Akmal
thanks From: Tyler Hobbs [mailto:ty...@datastax.com] Sent: Thursday, October 11, 2012 1:42 PM To: user@cassandra.apache.org Subject: Re: unsubscribe http://wiki.apache.org/cassandra/FAQ#unsubscribe On Thu, Oct 11, 2012 at 12:41 PM, Siddiqui, Akmal wrote:

Repair Failing due to bad network

2012-10-11 Thread David Koblas
I'm trying to bring up a new Datacenter - while I probably could have brought things up in another way I've now got a DC that has a ready Cassandra with keys allocated. The problem is that I cannot get a repair to complete due since it appears that some part of my network decides to restart al

Re: Repair Failing due to bad network

2012-10-11 Thread Jim Cistaro
I am not aware of any built-in mechanism for retrying repairs. I believe you will have to build that into your process. As for reducing the time of each repair command to fit in your windows: If you have multiple reasonable size column families, and are not already doing this, one approach might

Re: Perlcassa - Perl Cassandra 'Client'

2012-10-11 Thread Watanabe Maki
Perl never die... As Fortran From iPhone On 2012/10/12, at 3:09, Michael Kjellman wrote: > Hi- A few months back I wrote a Perl client for Cassandra and I realized I > never sent it out to this list. While I realize that while Perl is not the > language du jour hopefully this will help someo

Cassandra nodes loaded unequally

2012-10-11 Thread Ben Kaehne
Good morning, I am running a simple 3 node cluster. Each node is relatively powerful. (16 core, lots of ram, good disk etc). All machines are identical. Token ranges are all equal (generated with the python script on datastax website) Although under heavy load I can see the "unix load" be rather

Re: 1.1.1 is "repair" still needed ?

2012-10-11 Thread Watanabe Maki
Oh sorry. It's pretty nice to know that. On 2012/10/12, at 0:18, "B. Todd Burruss" wrote: > as of 1.0 (CASSANDRA-2034) hints are generated for nodes that timeout. > > On Thu, Oct 11, 2012 at 3:55 AM, Watanabe Maki > wrote: >> Even if HH works fine, HH will not be created until the failure de

Re: Option for ordering columns by timestamp in CF

2012-10-11 Thread Ertio Lew
"Make column timestamps optional"- kidding me, right ?:) I do understand that this wont be possible as then cassandra wont be able to distinguish the latest among several copies of same column. I dont mean that. I just want the while ordering the columns, Cassandra(in an optional mode per CF) shou