find smallest counter

2012-10-21 Thread Paul Loy
lest group. Many thanks in advance, Paul. -- ----- Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: TimeUUID

2012-02-28 Thread Paul Loy
In a multi server env, to avoid key collisions timeuuid may be the better choice. On Monday, February 27, 2012, Tamar Fraenkel wrote: > Hi! > > I have a column family where I use rows as "time buckets". > What I do is take epoc time in seconds, and round it to 1 hour (taking the > result of time_

Re: [RELEASE] Apache Cassandra 0.8.10 released

2012-02-14 Thread Paul Loy
aged releases as quickly as possible, > and I'll do my best to make this delay smaller as time goes on. I do > not have a specific target date for 0.8.10 rpms, but "real soon" :) > > -- > Warm regards, > Michael Shuler > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Garbage collection freezes cassandra node

2011-12-19 Thread Paul Loy
freeze? Just allocate more memory? > > ** ** > > Thanks, > > > Rene > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy <>

Re: Monitoring....

2011-10-12 Thread Paul Loy
s for monitoring, trend analysis, etc.? > > ** ** > > **JConsole is useful for single node monitoring/etc but not scalable & > data obviously doesn't persist between sessions...** > > ** > ** > > Many thanks, > > > Brian > > -- -

Re: Does anybody know why Twitter stop integrate Cassandra as Twitter store?

2011-10-04 Thread Paul Loy
hing in the closet here. It's just a simple resource management issue. On Tue, Oct 4, 2011 at 11:43 AM, ruslan usifov wrote: > Hello > > 2011/10/4 Paul Loy > >> Did you read the article you posted? >> > Yes > > >> "*We believe that this isn't t

Re: Does anybody know why Twitter stop integrate Cassandra as Twitter store?

2011-10-04 Thread Paul Loy
a store for > Tweets, but there nothing said why they made this decision? Does anybody > have mo information > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: How can I check what the consistency level is?

2011-09-29 Thread Paul Loy
sor methods to discover the value. Is there a way to output the > Consistency level to make sure that what we have configured is what is > actually being used? > > Anthony > > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Best indexing solution for Cassandra

2011-09-29 Thread Paul Loy
; >> > >> I've had some experience with that. My main problem was that I had a > limited vocabulary and a large number of documents. It seems like solandra > kept all my documents on the same row for a given term. That means the > documents don't get spread out throught

Re: Updates lost

2011-09-01 Thread Paul Loy
king would be >> the column value which jives with the fact that you're saying it seems >> to depend on the value. >> >> (I haven't checked current nor past versions of pycassa to determine >> if this is plausible. Just speculating.) >> >> -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Suggested settings for number crunching

2011-08-19 Thread Paul Loy
-- > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 19/08/2011, at 3:43 AM, Paul Loy wrote: > > Yeah, the data after crunching drops to just 65000 columns so one Cassandra > is plenty. That will all go in memory on one box. It&

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
gin reading, take a look at the new bulk loader in > cassandra: > > http://www.datastax.com/dev/blog/bulk-loading > > -Jake > > > On Thu, Aug 18, 2011 at 11:03 AM, Paul Loy wrote: > >> Yeah, we're processing item similarities. So we are writing single columns &

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
PM, Jonathan Ellis wrote: > Step 0: use multiple threads to insert > > On Thu, Aug 18, 2011 at 10:03 AM, Paul Loy wrote: > > Yeah, we're processing item similarities. So we are writing single > columns > > at a time. Although we do batch these into 400 mutations befo

Re: Suggested settings for number crunching

2011-08-18 Thread Paul Loy
twork bound? > > -Jake > > On Thu, Aug 18, 2011 at 7:08 AM, Paul Loy wrote: > >> Hi All, >> >> I have a program that crunches through around 3 billion calculations. We >> store the result of each of these in cassandra to later query once in order >>

Suggested settings for number crunching

2011-08-18 Thread Paul Loy
I can change to increase the write throughput. Perhaps disabling all caching, etc, as I won't be able to keep it all in memory anyway and only want to query the results once. Any thoughts would be appreciated, Paul. -- - Paul Loy p...@keterace

Re: RF=1

2011-08-02 Thread Paul Loy
plitCallable.call(ColumnFamilyInputFormat.java:138) >at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >at java.util.concurrent.FutureTask.run(FutureTask.java:138) >at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) >

Re: host clocks

2011-07-25 Thread Paul Loy
we don't have those guarantees on EC2. Networks can fluctuate wildly. On Mon, Jul 25, 2011 at 2:00 PM, zGreenfelder wrote: > > > On Mon, Jul 25, 2011 at 8:51 AM, Paul Loy wrote: > >> As I understand it, this will not quarantee that they are millisecond >> accura

Re: host clocks

2011-07-25 Thread Paul Loy
http://www.endruntechnologies.com/faq.htm#How_accurate_is On Mon, Jul 25, 2011 at 1:38 PM, Sooraj S wrote: > may be you can sync the servers with "pool.ntp.org" with running ntp as a > service. > > > On 25 July 2011 14:34, Paul Loy wrote: > >> And I guess there's the ne

Re: host clocks

2011-07-25 Thread Paul Loy
t > correct. > > On Sunday, July 24, 2011, ้ญ้‡‘ไป™ wrote: > > hi all, > >I'm launching a cassandra cluster with 30 nodes. I wonder whether the > inconsistency of host clocks will influence the performance of cluster. > > Thanks! > > > > >

Re: How to scale Cassandra?

2011-07-04 Thread Paul Loy
Do you mean the ring does not change until the move has completed? On Mon, Jul 4, 2011 at 4:49 PM, Edward Capriolo wrote: > > > On Mon, Jul 4, 2011 at 10:21 AM, Paul Loy wrote: > >> Well, by issuing a nodetool move when a node is under high load, you >> basically mak

Re: How to scale Cassandra?

2011-07-04 Thread Paul Loy
ies. The typical recommendation is RF=3 and > QUORUM reads/writes. > > ** ** > > Dan**** > > ** ** > > *From:* Paul Loy [mailto:ketera...@gmail.com] > *Sent:* July-04-11 5:59 > *To:* user@cassandra.apache.org > *Subject:* Re: How to scale Cassandra? > > ** *

Re: How to scale Cassandra?

2011-07-04 Thread Paul Loy
hat I didn't understand or do I miss something else? Is > the only left strategy to make sure that > the cluster grows unbalanced so one can add nodes to the hotspots? However > in this case you have to make sure > that this strategy is lasting. Could be too optimistic... > >

Re: working with time uuid

2011-06-06 Thread Paul Loy
well, to clarify, it first checks the timestamp bytes, then the rest so it doesn;t say they're the same if they came from 2 different servers. On Mon, Jun 6, 2011 at 4:52 PM, Paul Loy wrote: > private static int compareTimestampBytes(ByteBuffer o1, ByteBuffer o2) > { &g

Re: working with time uuid

2011-06-06 Thread Paul Loy
#x27;t this mean the keys need to be > generated all on the same host when you either query or insert? Or > does cassandra only inspect the bits that represent the time stamp of > the UUID when performing a lookup? > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: What's the best approach to search in Cassandra

2011-06-04 Thread Paul Loy
dra CF with secondary indices, or plan > scan and compare of every record? > > Thanks a bunch! > > Mark > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
edlinuxg...@gmail.com] > *Sent:* Friday, June 03, 2011 12:00 PM > > *To:* user@cassandra.apache.org > *Subject:* Re: Loading Keyspace from YAML in 0.8 > > > > On Fri, Jun 3, 2011 at 12:35 PM, Paul Loy wrote: > >> ugh! >> >> On Fri, Jun 3, 2011 at 5:19 PM,

Re: Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
ugh! On Fri, Jun 3, 2011 at 5:19 PM, Edward Capriolo wrote: > > > On Fri, Jun 3, 2011 at 12:14 PM, Paul Loy wrote: > >> We embed cassandra in our app. When we first load a cluster, we specify >> one node in the cluster as the seed node. This node inst

Loading Keyspace from YAML in 0.8

2011-06-03 Thread Paul Loy
, -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
at guys' not coming back > this time.") > > On Fri, May 27, 2011 at 10:47 AM, Paul Loy wrote: > > I guess my next question is: the data should be complete somewhere in the > > ring with RF = 2. Does cassandra not redistribute the replication ring > > without a nodeto

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
I guess my next question is: the data should be complete somewhere in the ring with RF = 2. Does cassandra not redistribute the replication ring without a nodetool decommission call? On Fri, May 27, 2011 at 4:45 PM, Paul Loy wrote: > ahh, thanks. > > On Fri, May 27, 2011 at 4:43 PM,

Re: Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
ahh, thanks. On Fri, May 27, 2011 at 4:43 PM, Jonathan Ellis wrote: > Quorum of 2 is 2. You need at least RF=3 for quorum to tolerate losing > a node indefinitely. > > On Fri, May 27, 2011 at 10:37 AM, Paul Loy wrote: > > We have a 4 node cluster with a replication factor o

Cluster not recovering when a single node dies

2011-05-27 Thread Paul Loy
. -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: Priority queue in a single row - performance falls over time

2011-05-26 Thread Paul Loy
age was sent using IMP, the Internet Messaging Program. >> > >> > This email and any attachments to it may be confidential and are >> > intended solely for the use of the individual to whom it is addressed. >> > If you are not the intended recipient of this email, you must neither >> > take any action based upon its contents, nor copy or show it to anyone. >> > Please contact the sender if you believe you have received this email in >> > error. QinetiQ may monitor email traffic data and also the content of >> > email for the purposes of security. QinetiQ Limited (Registered in >> > England & Wales: Company Number: 3796233) Registered office: Cody >> Technology >> > Park, Ively Road, Farnborough, Hampshire, GU14 0LX >> http://www.qinetiq.com. >> > >> >> >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of DataStax, the source for professional Cassandra support >> http://www.datastax.com >> > > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: cassandra not reading keyspaces defined in cassandra.yaml

2011-05-09 Thread Paul Loy
Cassandra starts properly without giving any warnngs/error but does not >> create the keyspace offline >> which is defined above. >> >> Please suggest. >> >> Thanks >> Anurag >> > > > > -- > Narendra Sharma > Solution Architect > *http://www.persistentsys.com* > *http://narendrasharma.blogspot.com/* > > > -- - Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy

Re: caching change between 0.7.0 and 0.7.5

2011-05-06 Thread Paul Loy
shMap) which means we have to > > upgrade but I'm concerned that the changes mean our load/stress tests > will > > not be valid so just need some info to put my mind at ease! > > > > Many thanks, > > > > Paul. > > > > -- > > -

caching change between 0.7.0 and 0.7.5

2011-05-05 Thread Paul Loy
op in HashMap) which means we have to upgrade but I'm concerned that the changes mean our load/stress tests will not be valid so just need some info to put my mind at ease! Many thanks, Paul. -- ----- Paul Loy p...@keteracel.com http://uk.linkedin.com/in/paulloy