RE: Newbie: Question on JSON values

2013-09-04 Thread Hartzman, Leslie
Thanks. I'll check that out. Les From: Robert Coli [mailto:rc...@eventbrite.com] Sent: Wednesday, September 04, 2013 10:14 AM To: user@cassandra.apache.org Subject: Re: Newbie: Question on JSON values On Wed, Sep 4, 2013 at 10:12 AM, Hartzman, Leslie mailto:leslie.d.hartz...@medtroni

Newbie: Question on JSON values

2013-09-04 Thread Hartzman, Leslie
Hello, I'm just getting my feet wet with Cassandra and I wanted to know if it is possible to search a JSON value in a column and not just retrieve the whole JSON value? Thanks. Les [CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is

Re: Newbie: Question on JSON values

2013-09-04 Thread Robert Coli
On Wed, Sep 4, 2013 at 10:12 AM, Hartzman, Leslie < leslie.d.hartz...@medtronic.com> wrote: > I’m just getting my feet wet with Cassandra and I wanted to know if it > is possible to search a JSON value in a column and not just retrieve the > whole JSON value? > If you indexed it with Datastax Ed

Re: newbie question :got error 'org.apache.thrift.transport.TTransportException'

2012-05-31 Thread aaron morton
Sounds like https://issues.apache.org/jira/browse/CASSANDRA-4219?attachmentOrder=desc Drop back to 1.0.10 and have a play. Good luck. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/06/2012, at 6:38 AM, Chen, Simon wrote: > Hi, > I am new

newbie question :got error 'org.apache.thrift.transport.TTransportException'

2012-05-31 Thread Chen, Simon
Hi, I am new to Cassandra. I have started a Cassandra instance (Cassandra.bat), played with it for a while, created a keyspace Zodiac. When I kill Cassandra instance and restarted, the keyspace is gone but when I tried to recreate it, I got 'org.apache.thrift.transport.TTransportException' err

RE: Initial token - newbie question (version 1.0.8)

2012-04-13 Thread Jay Parashar
Thanks everybody! Appreciate it. From: Watanabe Maki [mailto:watanabe.m...@gmail.com] Sent: Wednesday, April 11, 2012 5:40 PM To: user@cassandra.apache.org Subject: Re: Initial token - newbie question (version 1.0.8) auto_bootstrap parameter has been removed and always enabled since 1.0

Re: Initial token - newbie question (version 1.0.8)

2012-04-11 Thread Watanabe Maki
al Message- > From: Jeremiah Jordan [mailto:jeremiah.jor...@morningstar.com] > Sent: Wednesday, April 11, 2012 3:03 PM > To: user@cassandra.apache.org > Subject: RE: Initial token - newbie question (version 1.0.8) > > You have to use nodetool move to change the token after the node has started

RE: Initial token - newbie question (version 1.0.8)

2012-04-11 Thread Paolo Bernardi
ere to configure the auto_bootstrap > parameter in version 1.0.8? > > Thanks > Jay > > -Original Message- > From: Jeremiah Jordan [mailto:jeremiah.jor...@morningstar.com] > Sent: Wednesday, April 11, 2012 3:03 PM > To: user@cassandra.apache.org > Subject:

RE: Initial token - newbie question (version 1.0.8)

2012-04-11 Thread Jay Parashar
Subject: RE: Initial token - newbie question (version 1.0.8) You have to use nodetool move to change the token after the node has started the first time. The value in the config file is only used on first startup. Unless you were using RF=3 on your 3 node ring, you can't just start with

RE: Initial token - newbie question (version 1.0.8)

2012-04-11 Thread Jeremiah Jordan
't be moving anything anyway, so you should just do it the right way and use nodetool. From: Jay Parashar [jparas...@itscape.com] Sent: Wednesday, April 11, 2012 1:44 PM To: user@cassandra.apache.org Subject: Initial token - newbie question (version 1.0.8)

Initial token - newbie question (version 1.0.8)

2012-04-11 Thread Jay Parashar
I created a 3 node ring with the intial_token blank. Of course as expected, Cassandra generated its own tokens on startup (e.g. tokens X, Y and Z) The nodes or course were not properly balanced, so I did the following steps 1) stopped all the 3 nodes 2) assigned initial_tokens (A,

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-20 Thread Aditya Gupta
@Tamar: Thanks a ton! works perfect now! On Mon, Feb 20, 2012 at 12:02 PM, Tamar Fraenkel wrote: > On 19/02/2012 21:55, Aditya Gupta wrote: > > Is there anything to do with running cassandra on a VMware ubuntu instance > !? I am trying Cassandra on VMware ubuntu server instance. > > I am doing t

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-19 Thread Tamar Fraenkel
On 19/02/2012 21:55, Aditya Gupta wrote: Is there anything to do with running cassandra on a VMware ubuntu instance !? I am trying Cassandra on VMware ubuntu server instance. I am doing that for the past couple of weeks both on VMWare player and on ESXi in development and it works fine. My Ubun

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-19 Thread Aditya Gupta
Is there anything to do with running cassandra on a VMware ubuntu instance !? I am trying Cassandra on VMware ubuntu server instance. On Sun, Feb 19, 2012 at 2:45 AM, Aditya Gupta wrote: > In my case, after installing cassandra, as soon as the server is started > it hangs on it own (totally unre

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
In my case, after installing cassandra, as soon as the server is started it hangs on it own (totally unresponsive). It had openJDK-6's jdk & jre implementations. On Sat, Feb 18, 2012 at 10:30 PM, Guy Incognito wrote: > perhaps entirely unrelated, but somebody was asking about lockups on EC2 >

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Guy Incognito
perhaps entirely unrelated, but somebody was asking about lockups on EC2 yesterday and found: http://wiki.apache.org/cassandra/FAQ#ubuntu_hangs On 18/02/2012 14:58, Aditya Gupta wrote: Am I installing it the right way ? While installing I didn't verify the signatures using public key. On Sat,

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
Am I installing it the right way ? While installing I didn't verify the signatures using public key. On Sat, Feb 18, 2012 at 8:21 PM, Aditya Gupta wrote: > No data at all. just a fresh installation > > > On Sat, Feb 18, 2012 at 6:57 PM, R. Verlangen wrote: > >> You might want to check your Cass

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
No data at all. just a fresh installation On Sat, Feb 18, 2012 at 6:57 PM, R. Verlangen wrote: > You might want to check your Cassandra logs, they contain important > information that might lead you to the actual cause of the problems. > > 2012/2/18 Aditya Gupta > >> Thanks! But what about the

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Bart Swedrowski
On 18 February 2012 13:14, Aditya Gupta wrote: > Thanks! But what about the 100% cpu consumption that is causing the server > to hang? Do you have any application talking to that Cassandra, or is it just freshly installed Cassandra with no data at all?

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread R. Verlangen
You might want to check your Cassandra logs, they contain important information that might lead you to the actual cause of the problems. 2012/2/18 Aditya Gupta > Thanks! But what about the 100% cpu consumption that is causing the server > to hang? > > > On Sat, Feb 18, 2012 at 6:19 PM, Watanabe

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
For clarification, I'm running Cassandra on a VMware ubuntu server instance. On Sat, Feb 18, 2012 at 6:44 PM, Aditya Gupta wrote: > Thanks! But what about the 100% cpu consumption that is causing the server > to hang? > > > On Sat, Feb 18, 2012 at 6:19 PM, Watanabe Maki wrote: > >> I haven't use

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
Thanks! But what about the 100% cpu consumption that is causing the server to hang? On Sat, Feb 18, 2012 at 6:19 PM, Watanabe Maki wrote: > I haven't use the packaged kit, but Cassandra uses half of physical memory > on your system by default. > You need to edit cassandra-env.sh to decrease heap

Re: Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Watanabe Maki
I haven't use the packaged kit, but Cassandra uses half of physical memory on your system by default. You need to edit cassandra-env.sh to decrease heap size. Update MAX_HEAP_SIZE and NEW_HEAP_SIZE and restart. From iPhone On 2012/02/18, at 20:40, Aditya Gupta wrote: > I just installed Cassan

Newbie Question: Cassandra consuming 100% CPU on ubuntu server

2012-02-18 Thread Aditya Gupta
I just installed Cassandra on my ubuntu server by adding the following to the sources list: deb http://www.apache.org/dist/cassandra/debian 10x main deb-src http://www.apache.org/dist/cassandra/debian 10x main Soon after install I started getting OOM errors & then the server became unresponsive.

Re: Newbie question about writer/reader consistency

2011-12-29 Thread Jeremiah Jordan
So you can do this with Cassandra, but you need more logic in your code. Basically, you get the last safe number, M, then get N..M, if there are any gaps, you try again reading those numbers. As long as you are not over writing data, and you only update the last safe number after a successful

Re: Newbie question about writer/reader consistency

2011-12-27 Thread Radim Kolar
> But is there any way of implementing minimum required ACID subset on top of Cassandra? try this, its nosql ACID compliant. I haven't tested this, it will have most likely pretty slow writes and lot of bugs like any other oracle application. http://www.oracle.com/technetwork/database/nosqld

Re: Newbie question about writer/reader consistency

2011-12-27 Thread Vladimir Mosgalin
Hi R. Verlangen! On 2011.12.27 at 15:50:24 +0100, R. Verlangen wrote next: > You might consider a hybrid solution with a transactional db for all data > that should be ACID complient and Cassandra for the huge amounts of data > you want to store. > > 2011/12/27 Radim Kolar > > > > > makes me

Re: Newbie question about writer/reader consistency

2011-12-27 Thread R. Verlangen
You might consider a hybrid solution with a transactional db for all data that should be ACID complient and Cassandra for the huge amounts of data you want to store. 2011/12/27 Radim Kolar > > makes me feel disappointed about consistency in Cassandra, but I wonder is >> there is a way to work a

Re: Newbie question about writer/reader consistency

2011-12-27 Thread Radim Kolar
makes me feel disappointed about consistency in Cassandra, but I wonder is there is a way to work around it. cassandra is not suitable for this kind of programs. CouchDB is slightly better, it has transactions but no locking and i am not sure if transaction isolation is supported now. mongodb

Newbie question about writer/reader consistency

2011-12-26 Thread Vladimir Mosgalin
Hello everybody. I am developer of financial-related application, and I'm currently evaluating various nosql databases for our current goal: storing various views which show state of the system in different aspects after each transaction. The write load seems to be bigger than typical SQL databas

Re: Newbie question - fetching multiple columns of different datatypes and conversion from byte[]

2011-10-31 Thread Ertio Lew
Should the different datatype col values or names be first read as byte buffer & then converted to appropriate type using Hector's provided serializers api like the way shown below ? ByteBuffer bb; .. String s= StringSerializer.get().fromByteBuffer(bb); Or are there any better ways ?

Re: Newbie question

2011-05-10 Thread aaron morton
is you will need to run 2 queries to get the data. > > -Naren > > On Tue, May 10, 2011 at 6:33 AM, Sam Ganesan wrote: > All: > > A newbie question to the aficianados. I understand that I can stipulate an > ordering mechanism when I create a column family to reflect what I am

Re: Newbie question

2011-05-10 Thread Nate McCall
If I understand correctly, CompositeType comparator (https://issues.apache.org/jira/browse/CASSANDRA-2231) may be of interest to you once it becomes available.

Re: Newbie question

2011-05-10 Thread Narendra Sharma
2 queries to get the data. -Naren On Tue, May 10, 2011 at 6:33 AM, Sam Ganesan wrote: > All: > > A newbie question to the aficianados. I understand that I can stipulate an > ordering mechanism when I create a column family to reflect what I am > querying in the long run. Gene

Newbie question

2011-05-10 Thread Sam Ganesan
All: A newbie question to the aficianados. I understand that I can stipulate an ordering mechanism when I create a column family to reflect what I am querying in the long run. Generally I need to query a particular column space that I am contructing based on two different columns. The

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-31 Thread aaron morton
It iterates over all the SSTables and disk and estimates the number of keys by looking at how big the index is. It does not count the actual keys. aaron On 31 Mar 2011, at 17:46, Sheng Chen wrote: > I just found an estmateKeys() method of the ColumnFamilyStoreMBean. > Is there any indication

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-30 Thread Sheng Chen
I just found an estmateKeys() method of the ColumnFamilyStoreMBean. Is there any indication about how it works? Sheng 2011/3/28 Sheng Chen > Hi all, > I want to know how many records I am holding in Cassandra, just like > count(*) in sql. > What can I do ? Thank you. > > Sheng > > >

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-29 Thread Sheng Chen
ll keys is much faster but less elegant and can be more annoying > if you want do that from your application. > > > > Hope that do the trick for you. > > -Orr > > > > -Original Message- > > From: Joshua Partogi [mailto:joshua.j...@gmail.com] > > Se

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-28 Thread Stephen Connolly
on. > > Hope that do the trick for you. > -Orr > > -Original Message- > From: Joshua Partogi [mailto:joshua.j...@gmail.com] > Sent: Monday, March 28, 2011 2:39 PM > To: user@cassandra.apache.org > Subject: Re: newbie question: how do I know the total number of rows of a

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-28 Thread Stephen Connolly
ok, so not all nosql has column families... just s/nosql/cassandra/g on my previous post ;-) On 28 March 2011 13:38, Joshua Partogi wrote: > Not all NoSQL is like that. Or perhaps the term NoSQL has became vague > these days. > > On Mon, Mar 28, 2011 at 6:16 PM, Stephen Connolly > wrote: >> i

RE: newbie question: how do I know the total number of rows of a cf?

2011-03-28 Thread Or Yanay
[mailto:joshua.j...@gmail.com] Sent: Monday, March 28, 2011 2:39 PM To: user@cassandra.apache.org Subject: Re: newbie question: how do I know the total number of rows of a cf? Not all NoSQL is like that. Or perhaps the term NoSQL has became vague these days. On Mon, Mar 28, 2011 at 6:16 PM,

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-28 Thread Joshua Partogi
Not all NoSQL is like that. Or perhaps the term NoSQL has became vague these days. On Mon, Mar 28, 2011 at 6:16 PM, Stephen Connolly wrote: > iterate. > > otherwise if that will be too slow and you will do it often, the nosql way > is to create a separate column family updated with each row add/d

Re: newbie question: how do I know the total number of rows of a cf?

2011-03-28 Thread Stephen Connolly
iterate. otherwise if that will be too slow and you will do it often, the nosql way is to create a separate column family updated with each row add/delete to hold the answer for you. - Stephen --- Sent from my Android phone, so random spelling mistakes, random nonsense words and other nonsense a

newbie question: how do I know the total number of rows of a cf?

2011-03-27 Thread Sheng Chen
Hi all, I want to know how many records I am holding in Cassandra, just like count(*) in sql. What can I do ? Thank you. Sheng

Re: Newbie question - logsandra Flume Sink plugin.

2011-01-06 Thread Tyler Hobbs
Hi Derek, The Cassandra sink currently only works with Cassandra 0.7, although I don't suppose that is what is causing the 'InvalidSink' problem. What version of Flume are you using? The plugin works with Flume 0.9.1, but for 0.9.2 they upgraded the Thrift library version that the project uses a

Newbie question - logsandra Flume Sink plugin.

2011-01-06 Thread Deeter, Derek
Hi - I'm not sure if this should be asked on the Cassandra or Flume list, so I'm trying both - I am trying to do a proof of concept for logging into Cassandra. We need to capture large volumes of audit events in a non-lossy manner at the same time being able to quickly access those events fo

Re: Newbie question - fetching multiple columns of differentdatatypes and conversion from byte[]

2010-12-25 Thread Roshan Dawrani
- > > Sent from BlackBerry > > > > -Original Message- > > From: Jonathan Ellis > > Date: Sat, 25 Dec 2010 00:05:44 > > To: user > > Reply-To: user@cassandra.apache.org > > Subject: Re: Newbie question - fetchin

Re: Newbie question - fetching multiple columns of differentdatatypes and conversion from byte[]

2010-12-25 Thread Nate McCall
e app? > > Thanks. > Roshan > --- > Sent from BlackBerry > > -Original Message- > From: Jonathan Ellis > Date: Sat, 25 Dec 2010 00:05:44 > To: user > Reply-To: user@cassandra.apache.org > Subject: Re: Newbie que

Re: Newbie question - fetching multiple columns of differentdatatypes and conversion from byte[]

2010-12-24 Thread roshandawrani
, 25 Dec 2010 00:05:44 To: user Reply-To: user@cassandra.apache.org Subject: Re: Newbie question - fetching multiple columns of different datatypes and conversion from byte[] Or you can specify the types with the column name instead of doing a slice. On Fri, Dec 24, 2010 at 11:23 PM, Nate McCall

Re: Newbie question - fetching multiple columns of different datatypes and conversion from byte[]

2010-12-24 Thread Jonathan Ellis
Or you can specify the types with the column name instead of doing a slice. On Fri, Dec 24, 2010 at 11:23 PM, Nate McCall wrote: > In the case where you have different value types within the same > slice, yes, you must handle the conversion yourself and > ByteBufferSerializer is the easiest way t

Re: Newbie question - fetching multiple columns of different datatypes and conversion from byte[]

2010-12-24 Thread Nate McCall
In the case where you have different value types within the same slice, yes, you must handle the conversion yourself and ByteBufferSerializer is the easiest way to do that. On Fri, Dec 24, 2010 at 10:44 PM, Roshan Dawrani wrote: > Hi, > > I am new to Cassandra and Hector and have a basic question

Newbie question - fetching multiple columns of different datatypes and conversion from byte[]

2010-12-24 Thread Roshan Dawrani
Hi, I am new to Cassandra and Hector and have a basic question on fetching multiple columns of a row that have mixed data types. So, I am basically doing equivalent of "Select dateCol1, dateCol2, stringCol1, intCol1 from a_table where key in (?, ?, ?...)" My question is do I need to do the conve

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Alberto Velandia
I've found the solution, thanks for the help, I needed to change the addresses on the storage-conf.xml both ListenAddress and ThriftAddress to the address of the server itself. Sorry about the snippet being incomplete btw On Dec 6, 2010, at 4:18 PM, Ryan King wrote: > It would help if you giv

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Ryan King
It would help if you give us more context. The code snippet you've given us is incomplete and not very helpful. -ryan On Mon, Dec 6, 2010 at 12:33 PM, Alberto Velandia wrote: > Hi I've successfully managed to connect to the server through the > cassandra-cli command but still no luck on doing it

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Alberto Velandia
Hi I've successfully managed to connect to the server through the cassandra-cli command but still no luck on doing it from Fauna, I'm running cassandra 0.6.8 and I did the usual require 'cassandra' I've changed the ThriftAddress on the storage-conf.xml to the IP address of the server itself, do

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Aaron Morton
You can run the cassandra-cli from any machine. If you run it from the same machine as your ruby code it's a reliable way to check you can connect to the cluster. ok, next set of questions- what version of cassandra are you using ? Is it 0.7?- what require did you run ? was it require 'cassandr

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Alberto Velandia
I've tried the keyspaces() function and got this on return: compass.keyspaces() CassandraThrift::Cassandra::Client::TransportException: CassandraThrift::Cassandra::Client::TransportException from /home/compass/.rvm/gems/ruby-1.9.2...@rails3/gems/thrift-0.2.0.4/lib/thrift/transport/socke

Re: Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Aaron Morton
What function are you calling to get data and what is the error ?Try calling a function like keyspaces(), it should return a list of the keyspaces in your cluster  and is a good way to test things are connected.If there is still no joy check you can connect to your cluster using the cassandra-cli c

Newbie question about connecting to a cassandra server from another server using Fauna

2010-12-06 Thread Alberto Velandia
Hi I'm trying to create a connection to a server running cassandra doing this: compass = Cassandra.new('Compas', servers="223.798.456.123:9160") But once I try to get some data I realize that there's no connection, any ideas?? I'm I missing something ? Thanks

RE: Newbie question on Cassandra mem usage

2010-11-26 Thread Dr. Andrew Perella
Sorry - just realised this is now a parameter on the CFDef From: Dr. Andrew Perella [mailto:a...@eutechnyx.com] Sent: 26 November 2010 14:17 To: user@cassandra.apache.org Subject: RE: Newbie question on Cassandra mem usage How can I set these per CF when I create them dynamically? Regards

RE: Newbie question on Cassandra mem usage

2010-11-26 Thread Dr. Andrew Perella
How can I set these per CF when I create them dynamically? Regards, Andrew From: Aaron Morton [mailto:aa...@thelastpickle.com] Sent: 22 November 2010 21:40 To: user@cassandra.apache.org Subject: Re: Newbie question on Cassandra mem usage They are memtable_throughput_in_mb

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Aaron Morton
They are memtable_throughput_in_mb, memtable_flush_after_mins, memtable_operations_in_millions. Under 0.7 these are per CF settings, in 0.6 these are cluster wide. To start with try  mb one down to something like 64 or 128, ops to 0.5 and mins to 60 . What version are you using ? AaronOn 23 Nov, 20

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Trung Tran
Hi, Is it the min_compaction_threshold and max_compaction_threshold? Do i need to lower the memtable setting also? Thanks, Trung. On Mon, Nov 22, 2010 at 12:02 PM, Jonathan Ellis wrote: > Set your columnfamily thresholds lower. > > On Mon, Nov 22, 2010 at 12:45 PM, Trung Tran wrote: >> Hi, >>

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Jonathan Ellis
Set your columnfamily thresholds lower. On Mon, Nov 22, 2010 at 12:45 PM, Trung Tran wrote: > Hi, > > I have a test cluster of 3 nodes, 14Gb of mem in each node, > replication factor = 3. With default -Xms and Xmx, my nodes are set to > have max-heap-size = 7Gb. After initial load with about 200M

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Trung Tran
Hi, Thanks for the guideline. I did not turn up any memory setting, the nodes are configured with all default settings (except for disk-access is using nmap). I have 3 nodes with 1 client using hector, 8 writing threads. There are 3 CF, 1 standard and 2 super. Thanks, Trung. On Mon, Nov 22, 2010

Re: Newbie question on Cassandra mem usage

2010-11-22 Thread Aaron Morton
The higher memory usage for the java process may be because of memory mapped file access, take a look at the disk_access_mode in cassandra.yaml WRT going OutOfMemory:- what are your Memtable thresholds in cassandra.yaml ? - how many Column Families do you have? - What are your row and key cache set

Newbie question on Cassandra mem usage

2010-11-22 Thread Trung Tran
Hi, I have a test cluster of 3 nodes, 14Gb of mem in each node, replication factor = 3. With default -Xms and Xmx, my nodes are set to have max-heap-size = 7Gb. After initial load with about 200M rows (write with hector default consistencylevel = quorum,) my nodes memory usage are up to 13.5Gb, sh

Re: Cassandra newbie question

2010-10-27 Thread Arijit Mukherjee
Thanx Gary. I was thinking of using range partitioning for breaking the input. Say, we could have different threads handling diffierent rages - (A-J) by thread1, (K-P) by thread2. This way, there won't probably be any chance of collision. But the thread which actually performs the distribution cou

Re: Cassandra newbie question

2010-10-27 Thread Gary Dusbabek
On Wed, Oct 27, 2010 at 03:24, Arijit Mukherjee wrote: > Hi All > > I've another related question. > > I am using a stream of records of the form (A, B, n) where the pair > (A,B) can occur multiple times. For example, you could have the > following rset of records - > > A, B, 2 > P, Q, 5 > X, Y, 3

Re: Cassandra newbie question

2010-10-27 Thread Arijit Mukherjee
Hi All I've another related question. I am using a stream of records of the form (A, B, n) where the pair (A,B) can occur multiple times. For example, you could have the following rset of records - A, B, 2 P, Q, 5 X, Y, 3 A, B, 8 A, B, 2 ... The data store has a set of columns - (key, count, s

Re: Cassandra newbie question

2010-10-11 Thread Gary Dusbabek
On Mon, Oct 11, 2010 at 04:01, Arijit Mukherjee wrote: > Hi All > > I've just started reading about Cassandra and writing simple tests > using Cassandra 0.6.5 to see if we can use it for our product. > > I have a data store with a set of columns, like C1, C2, C3, and C4, > but the columns aren't m

Re: Cassandra newbie question

2010-10-11 Thread Arijit Mukherjee
Just a follow on question to this - would PIG be a good fit for such questions? Arijit On 11 October 2010 14:31, Arijit Mukherjee wrote: > Hi All > > I've just started reading about Cassandra and writing simple tests > using Cassandra 0.6.5 to see if we can use it for our product. > > I have a d

Cassandra newbie question

2010-10-11 Thread Arijit Mukherjee
Hi All I've just started reading about Cassandra and writing simple tests using Cassandra 0.6.5 to see if we can use it for our product. I have a data store with a set of columns, like C1, C2, C3, and C4, but the columns aren't mandatory. For example, there can be a list of (k.v) pairs with only

Re: Newbie Question about restarting Cassandra

2010-10-08 Thread Jonathan Ellis
On Fri, Oct 8, 2010 at 2:12 AM, Peter Schuller wrote: >> If your C* process dies and/or is killed you should not lose data.  It's >> written to the commit log before the client is acked, however that entry may >> not have made it to disk yet in the case of commitlogsync=periodic.  So, if >> you ki

Re: Newbie Question about restarting Cassandra

2010-10-08 Thread Peter Schuller
> If your C* process dies and/or is killed you should not lose data.  It's > written to the commit log before the client is acked, however that entry may > not have made it to disk yet in the case of commitlogsync=periodic.  So, if > you kill the C* process you're fine.  If you nicely restart the O

Re: Newbie Question about restarting Cassandra

2010-10-07 Thread Matthew Dennis
dnesday, October 06, 2010 8:53 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Newbie Question about restarting Cassandra > > > > Rob is correct. > > drain is really on there for when you need the commit log to be empty (some > upgrades or a complete backup of a shutdown cluster). &g

RE: Newbie Question about restarting Cassandra

2010-10-07 Thread David McIntosh
Are there any data loss concerns if you have the commit log sync set to periodic and are writing with CL One or Any? From: Matthew Dennis [mailto:mden...@riptano.com] Sent: Wednesday, October 06, 2010 8:53 PM To: user@cassandra.apache.org Subject: Re: Newbie Question about restarting

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Matthew Dennis
Rob is correct. drain is really on there for when you need the commit log to be empty (some upgrades or a complete backup of a shutdown cluster). There really is no point to using to shutdown C* normally, just kill it... On Wed, Oct 6, 2010 at 4:18 PM, Rob Coli wrote: > On 10/6/10 1:13 PM, Aar

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Rob Coli
On 10/6/10 1:13 PM, Aaron Morton wrote: To shutdown cleanly, say in a production system, use nodetool drain first. This will flush the memtables and put the node into a read only mode, AFAIK this also gives the other nodes a faster way of detecting the node is down via the drained node gossiping

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Aaron Morton
To shutdown cleanly, say in a production system, use nodetool drain first. This will flush the memtables and put the node into a read only mode, AFAIK this also gives the other nodes a faster way of detecting the node is down via the drained node gossiping it's new status. Then kill. AaronOn 07 Oct

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Matthew Dennis
Some relevant reading if you're interested: http://dslab.epfl.ch/pubs/crashonly/ http://web.archive.org/web/20060426230247/http://crash.stanford.edu/ On Wed, Oct 6, 2010 at 1:46 PM, Scott Mann wrote: > Yes. ctrl-C if running in the foreground. Use kill , if running > in the background (see the

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Scott Mann
Yes. ctrl-C if running in the foreground. Use kill , if running in the background (see the man page for kill if you are unfamiliar with it). Killing Cassandra is the only way to terminate it. On Wed, Oct 6, 2010 at 11:03 AM, Alberto Velandia wrote: > So, is ctrl + C how you stop cassandra? or I'm

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Alberto Velandia
So, is ctrl + C how you stop cassandra? or I'm i better doing it another way? Thanks On Oct 6, 2010, at 11:59 AM, Norman Maurer wrote: > CTRL + Z does not stop a programm it just suspend it. You will need to > resume it with "fg" and then hit CTRL + C to stop it. > > For some basic background:

Re: Newbie Question about restarting Cassandra

2010-10-06 Thread Norman Maurer
CTRL + Z does not stop a programm it just suspend it. You will need to resume it with "fg" and then hit CTRL + C to stop it. For some basic background: http://linuxreviews.org/beginner/jobs/ Bye, Norman 2010/10/6 Alberto Velandia : > Hi I've stopped cassandra hitting Ctrl + Z and tried to rest

Newbie Question about restarting Cassandra

2010-10-06 Thread Alberto Velandia
Hi I've stopped cassandra hitting Ctrl + Z and tried to restart it and got this message: INFO 11:46:16,039 JNA not found. Native methods will be disabled. INFO 11:46:16,159 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap ERROR 11:46:16,449 Fatal exception during initializa

Re: newbie question on how columns names are indexed/lucene limitations?

2010-04-26 Thread Schubert Zhang
:54am > To: user@cassandra.apache.org > Subject: newbie question on how columns names are indexed/lucene > limitations? > > Hello Cassandra Users, > > When use the RandomPartinionner and a simple ColumnFamily/Columns (i.e. > no SuperColumns) my understanding is that one sig

RE: newbie question on how columns names are i ndexed/lucene limitations?

2010-04-25 Thread Stu Hood
are scheduled to be fixed soon. -Original Message- From: "TuX RaceR" Sent: Sunday, April 25, 2010 11:54am To: user@cassandra.apache.org Subject: newbie question on how columns names are indexed/lucene limitations? Hello Cassandra Users, When use the RandomPartinionner an

newbie question on how columns names are indexed/lucene limitations?

2010-04-25 Thread TuX RaceR
Hello Cassandra Users, When use the RandomPartinionner and a simple ColumnFamily/Columns (i.e. no SuperColumns) my understanding is that one signle Row can store millions of columns. If I look at the http://wiki.apache.org/cassandra/API, I understand that I can get a subset of the millions o

Re: (another) Newbie question

2010-04-16 Thread Jonathan Ellis
The important distinction here is that you can slice on columns in a row, but you can't slice on column family (or keyspace) names, because the data isn't stored contiguously. The row, within the columnfamily, is the unit of data storage and api focus. On Sat, Apr 17, 2010 at 12:42 AM, Benjamin B

Re: (another) Newbie question

2010-04-16 Thread Benjamin Black
The multi-level dictionary explanation holds. Regex on keys like that is something specific language implementations support, not something inherent in a dictionary data structure. The table model is particularly fraught because it drags in a lot of relational assumptions, none of which hold. An

Re: (another) Newbie question

2010-04-16 Thread Jonathan Ellis
On Mon, Apr 12, 2010 at 9:48 AM, Colin Yates wrote: > I was hoping I could do a get_range_slices specifying 'project*' for the > columnFamily and a keyRange start: 20100107, end:20100109 but I > get an error 'InvalidRequestException(why:unconfigured columnfamily > project*)'. I think you've been

(another) Newbie question

2010-04-12 Thread Colin Yates
Hi, Assume I have: SCF: Projects : { CF:"project1": { 20100101: {cost:10, other columns}, 20100102: {cost:10, other columns}, . 20100120: {cost 10, other columns} }, CF:"project2": { 20100105: {cost:12, other columns} .