Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-18 Thread Tolbert, Andy
I think in the context of what I think initially motivated this hot reloading capability, a big win it provides is avoiding having to bounce your cluster as your certificates near expiry. If not watched closely you can get yourself into a state where every node in the cluster's cert expired, which

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-18 Thread Josh McKenzie
blebinary/enablebinary between >>>> instances, you will probably want to give some time between doing this >>>> so connections can reestablish, and you will want to verify that the >>>> connections can actually reestablish. You also need to be mindful of >>>&

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Abe Ratnofsky
>>> this being disruptive to inflight queries (if your client is >>> configured for retries it will probably be fine). Semantically to >>> your applications it should look a lot like a rolling cluster bounce. >>> >>> Thanks, >>> Andy >&

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Jeff Jirsa
this being disruptive to inflight queries (if your client is >> configured for retries it will probably be fine). Semantically to >> your applications it should look a lot like a rolling cluster bounce. >> >> Thanks, >> Andy >> >> On Mon, Apr 15, 202

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Dinesh Joshi
ueries (if your client is > configured for retries it will probably be fine). Semantically to > your applications it should look a lot like a rolling cluster bounce. > > Thanks, > Andy > > On Mon, Apr 15, 2024 at 11:39 AM pabbireddy avinash > wrote: > > > > Thanks

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Tolbert, Andy
to inflight queries (if your client is configured for retries it will probably be fine). Semantically to your applications it should look a lot like a rolling cluster bounce. Thanks, Andy On Mon, Apr 15, 2024 at 11:39 AM pabbireddy avinash wrote: > > Thanks Andy for your reply . We wil

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread pabbireddy avinash
Thanks Andy for your reply . We will test the scenario you mentioned. Regards Avinash On Mon, Apr 15, 2024 at 11:28 AM, Tolbert, Andy wrote: > Hi Avinash, > > As far as I understand it, if the underlying keystore/trustore(s) > Cassandra is configured for is updated, this *will

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Tolbert, Andy
Hi Avinash, As far as I understand it, if the underlying keystore/trustore(s) Cassandra is configured for is updated, this *will not* provoke Cassandra to interrupt existing connections, it's just that the new stores will be used for future TLS initialization. Via: https://cassandra.apache.org/d

ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread pabbireddy avinash
Dear Community, I hope this email finds you well. I am currently testing SSL certificate hot reloading on a Cassandra cluster running version 4.1 and encountered a situation that requires your expertise. Here's a summary of the process and issue: 1. Reloading Process: We reloaded certific

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-20 Thread Leena Ghatpande
. Thank you all for your responses. For now, offline sstablescrub on corrupt table has helped us bring back the cluster to a stable state. From: Erick Ramirez Sent: Wednesday, May 20, 2020 3:28 AM To: user@cassandra.apache.org Subject: Re: TEST Cluster corrupt

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-20 Thread Erick Ramirez
27;s happening then I think you're hitting CASSANDRA-14638 <https://jira.apache.org/jira/browse/CASSANDRA-14638>. It was fixed in C* 3.0.18, 3.11.4. If you still have the snapshots of the SSTables from before you scrubbed them, you can load them on a cluster with the latest C* 3.11.6 and t

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-19 Thread manish khandelwal
enough, all the repairs succeeded after this one table was > fixed. > > I am concerned why this occurred. We could live with loss of data on TEST. > but what would be done if this was PROD. > > Below is the full error message. > > WARN [SharedPool-Worker-1] 2020-05-18

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-19 Thread Leena Ghatpande
keep that in mind next time. Interestingly enough, all the repairs succeeded after this one table was fixed. I am concerned why this occurred. We could live with loss of data on TEST. but what would be done if this was PROD. Below is the full error message. WARN [SharedPool-Worker-1] 2020-05

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-18 Thread James Shaw
ndra 3.7 > our TEST cluster has 6 nodes, 3 in each data center > > replication factor 2 for keyspaces. > > we added 1 new node in each data center for testing making it 8 node > cluster. > > We decided to remove the 2 new nodes from cluster, but instead of > decommission, the

Re: TEST Cluster corrupt after removenode. how to restore

2020-05-18 Thread Erick Ramirez
On face value, it looks to me that your recovery approach is sound (but of course, the devil is in the details). If you're getting inconsistent results, try running the same query in cqlsh with CONSISTENCY ALL (to force a read-repair from both replicas). If you get the expected result, that would i

TEST Cluster corrupt after removenode. how to restore

2020-05-18 Thread Leena Ghatpande
Running cassandra 3.7 our TEST cluster has 6 nodes, 3 in each data center replication factor 2 for keyspaces. we added 1 new node in each data center for testing making it 8 node cluster. We decided to remove the 2 new nodes from cluster, but instead of decommission, the admin just deleted the

[ANNOUNCE] Gemini - an automated random test suite for Scylla and Apache Cassandra

2019-12-11 Thread Pekka Enberg
Hi, We are happy to announce Gemini, an automated random testing suite for Scylla and Apache Cassandra clusters: https://github.com/scylladb/gemini We are using the tool internally to test Scylla, but there's nothing Scylla-specific about it. The tool is written in Go and uses the gocql d

Re: Stress Test

2018-09-09 Thread Swen Moczarski
Hi, I found this blog quite helpful: https://www.instaclustr.com/deep-diving-into-cassandra-stress-part-1/ on 1, not sure if I understand your question correctly, but I would not start the stress test process on a Cassandra node which will be under test. on 3, the tool has already with an option

Stress Test

2018-09-06 Thread rajasekhar kommineni
Hello Folks, Does any body refer good documentation on Cassandra stress test. I have below questions. 1) Which server is good to start the test, Cassandra server or Application server. 2) I am using Datastax Java driver, is any good documentation for stress test specific to this driver. 3

RE: [EXTERNAL] Re: Cassandra rate dropping over long term test

2018-08-03 Thread Durity, Sean R
12:03 PM To: user@cassandra.apache.org Subject: [EXTERNAL] Re: Cassandra rate dropping over long term test I looked at the compaction history on the affected node when it was affected and it was not affected. The number of compactions is fairly similar and the amount of work also. Not affected

Re: Cassandra rate dropping over long term test

2018-08-03 Thread Mihai Stanescu
> I am perftesting cassandra over a longrun in a cluster of 8 nodes and i > noticed the rate of service drops. > > Most of the nodes have the CPU between 40-65% however one of the nodes > has a higher CPU and also started performing a lot of read IOPS as seen in > the image. (gree

Re: Cassandra rate dropping over long term test

2018-08-03 Thread Jeff Jirsa
performing a lot of read IOPS as seen in the > image. (green is read IOPS) > > My test has a mixed rw scenario. > 1. insert row > 2. after 60 seconds read row > 3. delete row. > > The rate of inserts is bigger than the rate of deletes so some delete will > not ha

Cassandra rate dropping over long term test

2018-08-03 Thread Mihai Stanescu
test has a mixed rw scenario. 1. insert row 2. after 60 seconds read row 3. delete row. The rate of inserts is bigger than the rate of deletes so some delete will not happen. I have checked the client it it does not accumulate RAM, GC is a straight line so o don't understand whats going on.

test email

2018-07-25 Thread R1 J1

Re: Stress test cassandr

2017-11-26 Thread Jonathan Haddad
Have you read through the docs for stress? You can have it use your own queries and data model. http://cassandra.apache.org/doc/latest/tools/cassandra_stress.html On Sun, Nov 26, 2017 at 1:02 AM Akshit Jain wrote: > Hi, > What is the best way to stress test the cassandra cluster with rea

Stress test cassandr

2017-11-26 Thread Akshit Jain
Hi, What is the best way to stress test the cassandra cluster with real life workloads which is being followed currently? Currently i am using cassandra stress-tool but it generated blob data /yaml files provides the option to use custom keyspace. But what are the different parameters values

Re: Test repair command

2017-09-05 Thread Alain RODRIGUEZ
Hi, To check that repairs are running, you should be able to see VALIDATION compactions (using 'nodetool compactionstats -H'). You could also see some streaming if you had some entropy (using 'nodetool netstats -H | grep -v 100%') during the repair. To know roughly the state of your data, you ca

Re: Test repair command

2017-09-04 Thread kurt greaves
Try checking the Percent Repaired reported in nodetool cfstats​

Test repair command

2017-09-01 Thread Akshit Jain
​Hi everyone, I'm new to cassandra.I was checking the nodetool repair command. I ran the command and got success but I am not able to figure out how to check repair has actually happened or not? It would be a great help if somebody can suggest a way to do that in terms of data check etc.

Re: Stress test

2017-07-27 Thread Jay Zhuang
The user and password should be in -mode section, for example: ./cassandra-stress user profile=table.yaml ops\(insert=1\) -mode native cql3 user=** password=** http://docs.datastax.com/en/cassandra/3.0/cassandra/tools/toolsCStress.html /Jay On 7/27/17 2:46 PM, Greg Lloyd wrote: > I am trying to

Stress test

2017-07-27 Thread Greg Lloyd
I am trying to use the cassandra stress tool with the user profile=table.yaml arguments specified and do authentication at the same time. If I use the user profile I get an error Invalid parameter user=* if I specify a user and password. Is it not possible to specify a yaml and use authenticat

Re: How to stress test collections in Cassandra Stress

2017-04-25 Thread Alain RODRIGUEZ
om 2017-04-24 15:08 GMT+02:00 LuckyBoy : > unsubscribe > > On Thu, Apr 13, 2017 at 7:26 AM, eugene miretsky < > eugene.miret...@gmail.com> wrote: > >> Hi, >> >> I'm trying to do a stress test on a a table with a collection column, but >>

Re: How to stress test collections in Cassandra Stress

2017-04-24 Thread LuckyBoy
unsubscribe On Thu, Apr 13, 2017 at 7:26 AM, eugene miretsky wrote: > Hi, > > I'm trying to do a stress test on a a table with a collection column, but > cannot figure out how to do that. > > I tried > > table_definition: | > CREATE TABLE list ( > c

Re: How to stress test collections in Cassandra Stress

2017-04-24 Thread Ahmed Eljami
Hi, Collections are not supported in cassandra-stress tool. I suggest you use Jmeter with cassandra java driver to do your stress test with collection or Spark. 2017-04-13 16:26 GMT+02:00 eugene miretsky : > Hi, > > I'm trying to do a stress test on a a table with a collecti

How to stress test collections in Cassandra Stress

2017-04-13 Thread eugene miretsky
Hi, I'm trying to do a stress test on a a table with a collection column, but cannot figure out how to do that. I tried table_definition: | CREATE TABLE list ( customer_id bigint, items list, PRIMARY KEY (customer_id)); columnspec: - name: customer_id size: fix

cassandra unit test

2016-09-05 Thread Stone Fang
Call QueryProcessor.execute method to insert data into table in cassandra unit test file. public static UntypedResultSet execute(String query, ConsistencyLevel cl, Object... values) throws RequestExecutionException { return execute(query, cl, internalQueryState(), values

On-disk size comparison test steps

2016-02-08 Thread Joseph Tech
Hi, I'm trying to compare the on-disk storage required for a column storing the same content but with two data types (text and blob) for key and value. These are defined in separate tables and same data is inserted to both. The table with blob has STCS and SnappyCompressor, while the one with text

Test Subject

2015-09-14 Thread Ajay Garg
Testing simple content, as my previous email bounced :( -- Regards, Ajay

test mail please ignore

2015-09-01 Thread Asit KAUSHIK

test email please ignore

2015-08-31 Thread Ahamed, Aadil
test

Re: How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread horschi
art, maybe you can see the setting use by raspberry pi project, > for instance > http://ac31004.blogspot.com/2012/05/apache-cassandra-on-raspberry-pi.html > > you can look at these two files, to tune down the settings for test > environment. > cassandra-env.sh > cassandra.yaml >

Re: How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread Jason Wee
for a start, maybe you can see the setting use by raspberry pi project, for instance http://ac31004.blogspot.com/2012/05/apache-cassandra-on-raspberry-pi.html you can look at these two files, to tune down the settings for test environment. cassandra-env.sh cassandra.yaml hth jason On Tue, Jun 9

How to minimize Cassandra memory usage for test environment?

2015-06-09 Thread Eax Melanhovich
Hello. We are running integration tests, using real Cassandra (not a mock) under Vagrant. MAX_HEAP_SIZE is set to 500M. As I discovered, lower value causes 'out of memory' after some time. Could memory usage be decreased somehow? Developers don't usually have a lot of free RAM and performance obv

unit test failing when pull is taken

2015-06-04 Thread Amit Singh F
Hi All, I have taken pull from Cassandra branch and when I try to run test cases , they start failing(around 13 test suites are failing). Below are some traces of some test suite which are failing : * [junit] Testsuite: org.apache.cassandra.db.compaction.BlacklistingCompactionsTest

Re: Cassandra Stress Test Result Evaluation

2015-03-09 Thread Jake Luciani
Your insert settings look unrealistic since I doubt you would be writing 50k rows at a time. Try to set this to 1 per partition and you should get much more consistent numbers across runs I would think. select: fixed(1)/10 On Wed, Mar 4, 2015 at 7:53 AM, Nisha Menon wrote: > I have been usin

Fwd: Cassandra Stress Test Result Evaluation

2015-03-09 Thread Nisha Menon
I have been using the cassandra-stress tool to evaluate my cassandra cluster for quite some time now. My problem is that I am not able to comprehend the results generated for my specific use case. My schema looks something like this: CREATE TABLE Table_test( ID uuid, Time timestamp,

Cassandra Stress Test Result Evaluation

2015-03-04 Thread Nisha Menon
I have been using the cassandra-stress tool to evaluate my cassandra cluster for quite some time now. My problem is that I am not able to comprehend the results generated for my specific use case. My schema looks something like this: CREATE TABLE Table_test( ID uuid, Time timestamp,

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-08 Thread Eric Stevens
> Do you mean that I should clear my table after each run? Indeed, I can see several times of compaction during my test, but could only a few times compaction affect the performance that much? It certainly affects performance. Read performance suffers first, then write performance suff

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-08 Thread Chris Lohfink
commend using cassandra-stress instead of own stuff if you want to test cassandra and not your code. === Chris Lohfink On Mon, Dec 8, 2014 at 4:57 AM, 孔嘉林 wrote: > Thanks Chris. > I run a *client on a separate* AWS *instance from* the Cassandra cluster > servers. At the client side, I cre

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-08 Thread 孔嘉林
connect to the corresponding Cassandra nodes and keep connecting during the whole process(I did not close all the transports until the end of the test process). So I use very simple load balancing, since the same number of thrift clients connect to each node. And my source code is here: https://github.com

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-07 Thread Chris Lohfink
I think your client could use improvements. How many threads do you have running in your test? With a thrift call like that you only can do one request at a time per connection. For example, assuming C* takes 0ms, a 10ms network latency/driver overhead will mean 20ms RTT and a max throughput

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-07 Thread 孔嘉林
Hi Eric, Thank you very much for your reply! Do you mean that I should clear my table after each run? Indeed, I can see several times of compaction during my test, but could only a few times compaction affect the performance that much? Also, I can see from the OpsCenter some ParNew GC happen but

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-07 Thread Eric Stevens
I'm sorry, I meant to say "6 nodes rf=3". Also look at this performance over sustained periods of times, not burst writing. Run your test for several hours and watch memory and especially compaction stats. See if you can walk in what data volume you can write while keep

Re: Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-07 Thread Eric Stevens
Hi Joy, Are you resetting your data after each test run? I wonder if your tests are actually causing you to fall behind on data grooming tasks such as compaction, and so performance suffers for your later tests. There are *so many* factors which can affect performance, without reviewing test

Cassandra Doesn't Get Linear Performance Increment in Stress Test on Amazon EC2

2014-12-06 Thread kong
Hi, I am doing stress test on Datastax Cassandra Community 2.1.2, not using the provided stress test tool, but use my own stress-test client code instead(I write some C++ stress test code). My Cassandra cluster is deployed on Amazon EC2, using the provided Datastax Community AMI( HVM instances

Re[2]: Test

2014-12-03 Thread Plotnik, Alexey
Alah Akbar -- Original Message -- From: "Servando Muñoz G." mailto:smg...@gmail.com>> To: "user@cassandra.apache.org" mailto:user@cassandra.apache.org>> Sent: 04.12.2014 16:12:32 Subject: RE: Test Saludos… Quien eres tu De: Castelain, Alain [

RE: Test

2014-12-03 Thread Servando Muñoz G .
Saludos… Quien eres tu De: Castelain, Alain [mailto:alain.castel...@xerox.com] Enviado el: miércoles, 3 de diciembre de 2014 09:46 a. m. Para: user@cassandra.apache.org Asunto: Test Test Cordialement, Regards, Alain Castelain Database Administrator Xerox - Global Document

Test

2014-12-03 Thread Castelain, Alain
Test Cordialement, Regards, Alain Castelain Database Administrator Xerox - Global Document Outsourcing 253, avenue du Président Wilson La Plaine Saint Denis Cedex, 93211 France http://www.xerox.fr/services/frfr.html p (+33) 155 847 333 m (+33) 682 999 617 @ alain.castel...@xerox.com

subscription test - please ignore

2014-05-13 Thread Maciej Miklas

[ANN] ccm-clj - test Cassandra clusters via Clojure

2014-04-08 Thread Colin Taylor
stcluster" cass-version num-nodes cql-port) (ccm/cql! (io/file "./test/resources/test-keyspace.cql")) (ccm/cql! (io/resource "schema/test-schema.cql") "testkeyspace") (ccm/cql! (io/file "./test/resources/test-data.cql") "testkeyspace"

RE: exception during add node due to test beforeAppend on SSTableWriter

2014-02-07 Thread Desimpel, Ignace
Issue created at https://issues.apache.org/jira/browse/CASSANDRA-6673 From: ravi prasad [mailto:raviprasad...@yahoo.com] Sent: donderdag 6 februari 2014 20:19 To: user@cassandra.apache.org Subject: Re: exception during add node due to test beforeAppend on SSTableWriter I'm seeing the same

Re: exception during add node due to test beforeAppend on SSTableWriter

2014-02-06 Thread ravi prasad
u open a jira reporting this issue? On Thursday, February 6, 2014 4:31 AM, "Desimpel, Ignace" wrote: Also, these nodes and data are entirely created by a 2.0.4 code, so should not really be a 1.1.x related bug. Also, I restarted the whole test, thus completely new data

FW: exception during add node due to test beforeAppend on SSTableWriter

2014-02-06 Thread Desimpel, Ignace
Also, these nodes and data are entirely created by a 2.0.4 code, so should not really be a 1.1.x related bug. Also, I restarted the whole test, thus completely new database, and I get similar problems. From: Desimpel, Ignace Sent: vrijdag 31 januari 2014 18:02 To: user@cassandra.apache.org

exception during add node due to test beforeAppend on SSTableWriter

2014-01-31 Thread Desimpel, Ignace
't drop in sstables, and have not yet run scrub, you should do so since you may also have rows out-of-order within an sstable From: Desimpel, Ignace Sent: vrijdag 31 januari 2014 17:43 To: user@cassandra.apache.org Subject: exception during add node due to test beforeAppend on SSTableW

exception during add node due to test beforeAppend on SSTableWriter

2014-01-31 Thread Desimpel, Ignace
4 node, byte ordered, LCS, 3 Compaction Executors, replication factor 1 Code is 2.0.4 version but with patch for CASSANDRA-6638 However, no cleanup is run so patch should not play a roll 4 node cluster is started and insert/queries are done u

Re: Introducing farsandra: A different way to integration test with c*

2014-01-29 Thread Edward Capriolo
Farsandra(); >> > fs.withVersion("2.0.4"); >> > fs.withCleanInstanceOnStart(true); >> > fs.withInstanceName("1"); >> > fs.withCreateConfigurationFiles(true); >> > fs.withHost("localhost"); >> > fs.wi

Re: Introducing farsandra: A different way to integration test with c*

2014-01-22 Thread Edward Capriolo
); > > fs.withCreateConfigurationFiles(true); > > fs.withHost("localhost"); > > fs.withSeeds(Arrays.asList("localhost")); > > fs.start(); > > > > The story: > > For a while I have been developing applications that use Apache >

Re: Introducing farsandra: A different way to integration test with c*

2014-01-22 Thread Jonathan Ellis
tions that use Apache Cassandra as > their data store. Personally I am more of an end-to-end test person then a > mock test person. For years I have relied heavily on Hector's embedded > cassandra to bring up Cassandra in a sane way inside a java project. > > The concept of Farsan

Re: Introducing farsandra: A different way to integration test with c*

2014-01-22 Thread Paulo Motta
st("localhost"); > fs.withSeeds(Arrays.asList("localhost")); > fs.start(); > > The story: > For a while I have been developing applications that use Apache Cassandra > as their data store. Personally I am more of an end-to-end test person then > a mock test per

Introducing farsandra: A different way to integration test with c*

2014-01-22 Thread Edward Capriolo
lhost"); fs.withSeeds(Arrays.asList("localhost")); fs.start(); The story: For a while I have been developing applications that use Apache Cassandra as their data store. Personally I am more of an end-to-end test person then a mock test person. For years I have relied heavily on

Re: Simple test of adding a node causes data loss

2013-11-21 Thread Tamar Rosen
ed cassandra.yaml as above except that for seeds put both server >> addresses >> started cassandra >> waited a couple of min >> >> What we found: >> nodetool status on either server shows two servers, each with appox 50% >> (but not exactly) >> cqlsh

Re: Simple test of adding a node causes data loss

2013-11-21 Thread Julien Campan
repeated 3 times. each time the number was a bit > different, but ~2000 > > Notes > Replication factor is 1. > No nodetool cleanup was run > > We have successfully added nodes in the past, but not since we moved to > using vnodes > THIS WAS A TEST. CLEAN MACHINES, SIMPLE DATA - What are we doing wrong? > > Thanks, > > Tamar Rosen > Senior Data Architect > Correlor.com > > > > > > >

Simple test of adding a node causes data loss

2013-11-21 Thread Tamar Rosen
was run We have successfully added nodes in the past, but not since we moved to using vnodes THIS WAS A TEST. CLEAN MACHINES, SIMPLE DATA - What are we doing wrong? Thanks, Tamar Rosen Senior Data Architect Correlor.com

How to test code using Java DataStax CQL client

2013-10-07 Thread Aleksandra Nowak
Hi all, I want to move to new Cassandra version and use Java DataStax CQL client with it. For now on I've been using Hector as a Java client and cassandra-unit to run junit test. What should I use to test the code now? Is there a special library for testing code using Datastax driver? I w

Re: how to test our transfer speeds

2013-04-03 Thread aaron morton
erstand. I am trying to > get a test run with just one disk to make sure the test is correct as one > disk should have much less performance than 20 in the case of random access. > In sequential, I think performance would be the same(ie. Both would be > 250MB/sec in throughput is

Re: how to test our transfer speeds

2013-04-02 Thread Hiller, Dean
Oh, JBOD, not JBOB. no, we were using RAID 5 and RAID 6 from what I understand. I am trying to get a test run with just one disk to make sure the test is correct as one disk should have much less performance than 20 in the case of random access. In sequential, I think performance would be

Re: how to test our transfer speeds

2013-04-02 Thread Hiller, Dean
>> Reply-To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Monday, April 1, 2013 11:01 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Su

Re: how to test our transfer speeds

2013-04-01 Thread aaron morton
formance tests on cassandra but wanted to > understand the raw foot print first)….. > > Someone in ops was doing a test transferring 1T of data from one node to > another. I had a huge concern I emailed him that this could end up being a > completely sequential write not testing ran

how to test our transfer speeds

2013-04-01 Thread Hiller, Dean
(we plan on running similar performance tests on cassandra but wanted to understand the raw foot print first)….. Someone in ops was doing a test transferring 1T of data from one node to another. I had a huge concern I emailed him that this could end up being a completely sequential write not

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Chengying Fang
ject: Re: Why Secondary indexes is so slowly by my test? Here is a good start. http://www.anuff.com/2011/02/indexing-in-cassandra.html On Thu, Dec 13, 2012 at 11:35 AM, Alain RODRIGUEZ wrote: Hi Edward, can you share the link to this blog ? Alain 2012/12/13 Edward Capriolo Ed ENuff s

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Tyler Hobbs
If anyone's interested in a little more background on the read-before-write fix that Ed mentioned, see: https://issues.apache.org/jira/browse/CASSANDRA-2897 On Thu, Dec 13, 2012 at 11:31 AM, Edward Capriolo wrote: > Here is a good start. > > http://www.anuff.com/2011/02/indexing-in-cassandra.htm

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Edward Capriolo
Here is a good start. http://www.anuff.com/2011/02/indexing-in-cassandra.html On Thu, Dec 13, 2012 at 11:35 AM, Alain RODRIGUEZ wrote: > Hi Edward, can you share the link to this blog ? > > Alain > > 2012/12/13 Edward Capriolo > >> Ed ENuff s > > >

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Alain RODRIGUEZ
Hi Edward, can you share the link to this blog ? Alain 2012/12/13 Edward Capriolo > Ed ENuff s

Re: Why Secondary indexes is so slowly by my test?

2012-12-13 Thread Edward Capriolo
4 PM, Chengying Fang wrote: > > You are right, Dean. It's due to the heavy result returned by query, not index itself. According to my test, if the result rows less than 5000, it's very quick. But how to limit the result? It seems row limit is a good choice. But if do so, some rows

Re: Why Secondary indexes is so slowly by my test?

2012-12-12 Thread aaron morton
://www.thelastpickle.com On 13/12/2012, at 6:34 PM, Chengying Fang wrote: > You are right, Dean. It's due to the heavy result returned by query, not > index itself. According to my test, if the result rows less than 5000, it's > very quick. But how to limit the result? It seems

Re: Why Secondary indexes is so slowly by my test?

2012-12-12 Thread Chengying Fang
You are right, Dean. It's due to the heavy result returned by query, not index itself. According to my test, if the result rows less than 5000, it's very quick. But how to limit the result? It seems row limit is a good choice. But if do so, some rows I wanted maybe miss because the

Re: Why Secondary indexes is so slowly by my test?

2012-12-12 Thread Hiller, Dean
day, December 11, 2012 8:22 PM To: user mailto:user@cassandra.apache.org>> Subject: Re: Why Secondary indexes is so slowly by my test? Thanks to Low. We use CompositeColumn to substitue it in single not-equality and definite equalitys query. And we will give up cassandra because of the we

Re: Why Secondary indexes is so slowly by my test?

2012-12-11 Thread Chengying Fang
1, 2012 07:44 PM To: "user"; Subject: Re: Why Secondary indexes is so slowly by my test? Hi, Secondary index lookups are more complicated than normal queries so will be slower. Items have to first be queried in the index, then retrieved from their actual location. Also, insert

Re: Why Secondary indexes is so slowly by my test?

2012-12-11 Thread Richard Low
e) > with cassandra, then I did test again as describe here. But the result is > the same as product. What's wrong with cassandra or me? > Now my test: > newly installed ubuntu-12.04 LTS , apache-cassandra-1.1.6, default > configure, just one keyspace(test) and one CF(TestIndex): &

Why Secondary indexes is so slowly by my test?

2012-12-06 Thread Chengying Fang
Hi guys, I found Secondary indexes too slowly in my product(amazon large instance) with cassandra, then I did test again as describe here. But the result is the same as product. What's wrong with cassandra or me? Now my test: newly installed ubuntu-12.04 LTS , apache-cassandra-1.1.6, de

Re: Test Data creation in Cassandra

2012-03-05 Thread aaron morton
try tools/stress in the source distribution. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 3/03/2012, at 6:01 AM, A J wrote: > What is the best way to create millions of test data in Cassandra ? > > I would like to have so

Test Data creation in Cassandra

2012-03-02 Thread A J
What is the best way to create millions of test data in Cassandra ? I would like to have some script where I first insert say 100 rows in a CF. Then reinsert the same data on 'server side' with new unique key. That will make it 200 rows. Then continue the exercise a few times till I

Re: MemtableThroughput test in ColumnFamily.apply

2012-02-27 Thread aaron morton
That sounds odd because it is checked after each row is added to the memtable. What are you seeing logged when the memtable flushes ? It will say how many ops and how many (tracked) bytes. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On

Re: MemtableThroughput test in ColumnFamily.apply

2012-02-25 Thread Thomas Richter
Hi, I agree, but the problem in our case is that we have rather small memtables (5MB) and during hinted handoff there are several dozen or even hundreds of MBs inserted without flushing the tables. And in that case it makes a difference. Best, Thomas On 02/25/2012 07:06 PM, Jonathan Ellis wrote

Re: MemtableThroughput test in ColumnFamily.apply

2012-02-25 Thread Jonathan Ellis
Makes sense to me, although I don't see it making a material difference when there are 1000 mutations in a memtable vs 1001. On Sat, Feb 25, 2012 at 11:23 AM, Thomas Richter wrote: > Hi, > > while hunting down some memory consumption issues in 0.7.10 I realized > that MemtableThroughput condition

MemtableThroughput test in ColumnFamily.apply

2012-02-25 Thread Thomas Richter
Hi, while hunting down some memory consumption issues in 0.7.10 I realized that MemtableThroughput condition is tested before writing the new data. As this causes memtables to grow larger than expected I changed Memtable apply(DecoratedKey key, ColumnFamily columnFamily) { long start

Re: Cassandra stress test and max vs. average read/write latency.

2012-01-02 Thread Peter Schuller
o reproduce them.  But > offhand, I don't see any to throttle back the load created by the > stress test. I'm not aware of one built-in. It would be a useful patch IMO, to allow setting a target rate. -- / Peter Schuller (@scode, http://worldmodscode.wordpress.com)

Re: Cassandra stress test and max vs. average read/write latency.

2011-12-23 Thread Peter Fales
, but I thought it made sense to use the official benchmark tool as people might more readily believe those results and/or be able to reproduce them. But offhand, I don't see any to throttle back the load created by the stress test. On Mon, Dec 19, 2011 at 09:47:32PM -0800, Peter Schuller w

Re: Cassandra stress test and max vs. average read/write latency.

2011-12-22 Thread Peter Schuller
> Thanks for your input.  Can you tell me more about what we should be > looking for in the gc log?   We've already got the gc logging turned > on and, and we've already done the plotting to show that in most > cases the outliers are happening periodically (with a period of > 10s of seconds to a fe

Re: Cassandra stress test and max vs. average read/write latency.

2011-12-22 Thread Peter Fales
Peter, Thanks for your input. Can you tell me more about what we should be looking for in the gc log? We've already got the gc logging turned on and, and we've already done the plotting to show that in most cases the outliers are happening periodically (with a period of 10s of seconds to a fe

  1   2   3   >