Re: Write speed roughly 1/10 of expected.

2011-03-14 Thread Tyler Hobbs
> > Re: Mr. Hobbs, > > Did you mean "which has the benefit of THRIFT-638, while 0.7.a.2 does not" > (instead of 0.7.a.3)? 0.7.a.3 was the latest version of phpcassa we could > find on github. We installed 0.7.a.3 with its C extension and didn't see an > improvement. Is there a newer version with TH

Re: Write speed roughly 1/10 of expected.

2011-03-14 Thread Steven Liu
Re: Mr. Schuller, The test documents are very small (a few lines of text each). Test data model is standard CF with each document correponding to a row containing 9-12 columns. We are using a single client for sequential batch_insert (probably maps to batch mutate in phpcassa), so it is very possi

Re: Write speed roughly 1/10 of expected.

2011-03-11 Thread Tyler Hobbs
> > (I have no idea how fast phpcassa is.) > The current master branch (which has the benefit of THRIFT-638, while 0.7.a.3 does not) can insert about 3k individual rows a second against a local Cassandra instance. -- Tyler Hobbs Software Engineer

Re: Write speed roughly 1/10 of expected.

2011-03-11 Thread Peter Schuller
> It took 219 minutes to insert 12+ million docs which translates to about 913 > docs/second using batch_insert in batches of 1250 documents per batch. How big are the documents and/or how big is the resulting data when loaded? What is your data model - is each document a single column? Or a row

Write speed roughly 1/10 of expected.

2011-03-11 Thread Steven Liu
We are using the latest phpcassa (phpcassa-0.7.a.2.tar.gz ) and cassandra 0.7.3, we have inserted 12+ million documents into one column family with the following keyspace/columnfamily settings: Keyspace: dffl: Replication Stra