Snitch

2019-07-17 Thread Rahul Reddy
Hello, All our infrastructure is in aws but we still use gossippropertyfilesnitch. We have two datacenters us_east_1 and us_west_2 trying to add us_east_1_analytics in the same aws DC as us_east_1and us_west_2_analytics in same aws DC us_west_2. Tried to use dc_suffix it seems to be helpful only i

Re: Switching Snitch

2018-08-26 Thread Pradeep Chhetri
Hello Joshua Thank you very much for the replies. I will go through the tickets you sent to understand the process. Regards, Pradeep On Mon, Aug 27, 2018 at 6:15 AM, rajasekhar kommineni wrote: > Hi Pradeep, > > For changing the snitch you have decommission and add the node with new

Re: Switching Snitch

2018-08-26 Thread rajasekhar kommineni
Hi Pradeep, For changing the snitch you have decommission and add the node with new switch and updated properties files. Thanks, > On Aug 26, 2018, at 2:15 PM, Joshua Galbraith > wrote: > > Pradeep, > > Here are some related tickets that may also be helpful in

Re: Switching Snitch

2018-08-26 Thread Joshua Galbraith
gt; >>> Regards, >>> Pradeep >>> >>> On Mon, Aug 27, 2018 at 12:19 AM, Joshua Galbraith < >>> jgalbra...@newrelic.com.invalid> wrote: >>> >>>> Pradeep, it sounds like what you're proposing counts as a topology >>>

Re: Switching Snitch

2018-08-26 Thread Joshua Galbraith
gt;> change because you are changing the datacenter name and rack name. >>> >>> Please refer to the documentation here about what to do in that >>> situation: >>> https://docs.datastax.com/en/cassandra/3.0/cassandra/operati >>> ons/opsSwitchSnitch.html >

Re: Switching Snitch

2018-08-26 Thread Joshua Galbraith
;re proposing counts as a topology change >> because you are changing the datacenter name and rack name. >> >> Please refer to the documentation here about what to do in that situation: >> https://docs.datastax.com/en/cassandra/3.0/cassandra/operati >> ons/opsSwitchSnitch

Re: Switching Snitch

2018-08-26 Thread Pradeep Chhetri
ing the datacenter name and rack name. > > Please refer to the documentation here about what to do in that situation: > https://docs.datastax.com/en/cassandra/3.0/cassandra/ > operations/opsSwitchSnitch.html > > In particular: > > Simply altering the snitch and replication

Re: Switching Snitch

2018-08-26 Thread Joshua Galbraith
l In particular: Simply altering the snitch and replication to move some nodes to a new > datacenter will result in data being replicated incorrectly. Topology changes may occur when the replicas are placed in different places > by the new snitch. Specifically, the replication strategy

Re: Switching Snitch

2018-08-26 Thread Pradeep Chhetri
Hello everyone, Since i didn't hear from anyone, just want to describe my question again: Am i correct in understanding that i need to do following steps to migrate data from SimpleSnitch to GPFS changing datacenter name and rack name to AWS region and Availability zone respectively 1) Update th

Switching Snitch

2018-08-23 Thread Pradeep Chhetri
Hello, I am currently running a 3.11.2 cluster in SimpleSnitch hence the datacenter is datacenter1 and rack is rack1 for all nodes on AWS. I want to switch to GPFS by changing the rack name to the availability-zone name and datacenter name to region name. When I try to restart individual nodes by

Re: What snitch to use with AWS and Google

2018-03-12 Thread Jeff Jirsa
GPFS -- Jeff Jirsa > On Mar 12, 2018, at 4:31 PM, Kenneth Brotman > wrote: > > Quick question: If you have one cluster made of nodes of a datacenter in AWS > and a datacenter in Google, what snitch do you use? > > Kenneth Brotman

Re: What snitch to use with AWS and Google

2018-03-12 Thread Lerh Chuan Low
Google- Better go with GossipingPropertyFileSnitch > > Thanks, > Madhu > > On Mon, Mar 12, 2018 at 6:31 PM, Kenneth Brotman < > kenbrot...@yahoo.com.invalid> wrote: > >> Quick question: If you have one cluster made of nodes of a datacenter in >> AWS and a datacenter in Google, what snitch do you use? >> >> >> >> Kenneth Brotman >> > >

Re: What snitch to use with AWS and Google

2018-03-12 Thread Madhu-Nosql
> AWS and a datacenter in Google, what snitch do you use? > > > > Kenneth Brotman >

What snitch to use with AWS and Google

2018-03-12 Thread Kenneth Brotman
Quick question: If you have one cluster made of nodes of a datacenter in AWS and a datacenter in Google, what snitch do you use? Kenneth Brotman

Understanding Dynamic Snitch Scores

2017-07-24 Thread Pranay akula
Hi, let's say i have 5 nodes a DC the dynamic snitch scores are A => '1.84106731901363' B => '1.1386762906094' C => '2.63620400428772', D => '3.06495631470972', E => '0', Badness_threshold is set to 1, Does this mean th

Re: Property file snitch and unbalanced cluster

2016-10-28 Thread Carlos Alonso
cluster is back to 1 datacenter with 3 nodes and then add them sequentially again making sure the configuration in the Snitch is the proper one. Regards. Carlos Alonso | Software Engineer | @calonso <https://twitter.com/calonso> On 28 October 2016 at 10:06, Robert Sicoie wrote: > Hi

Property file snitch and unbalanced cluster

2016-10-28 Thread Robert Sicoie
is why 1,2,3 have more data and the cluster is unbalanced. - all writes that come to 4 and 5 are replicated on 1,2,3,4 and 5 as the property file snitch config has info about the entire cluster on 4 and 5. Is it save if I just update the network topology file on 1, 2, 3 and add lines about

How to understand of dynamic snitch update interval?

2016-08-27 Thread Jun Wu
Hi there, I have a question for dynamic snitch, specifically in reading. For dynamic snitch, it is wrapped with other snitches. For reading, dynamic snitch plays a very important role, as mentioned in this article: http://www.datastax.com/dev/blog/dynamic-snitching-in-cassandra-past

Re: Changing snitch from PropertyFile to Gossip

2016-04-25 Thread Carlos Rolo
I just run it to be sure. Sometimes mistakes happen and it's a way to be sure. Em 25/04/2016 10:19, "Alain RODRIGUEZ" escreveu: > Hi Carlos, > > Why running a repair there if the topology did not change? Is it as a best > practice, just in case, or is there a specific reason? > > C*heers, > -

Re: Changing snitch from PropertyFile to Gossip

2016-04-25 Thread Alain RODRIGUEZ
Hi Carlos, Why running a repair there if the topology did not change? Is it as a best practice, just in case, or is there a specific reason? C*heers, --- Alain Rodriguez - al...@thelastpickle.com France The Last Pickle - Apache Cassandra Consulting http://www.thelastpickle.co

Re: Changing snitch from PropertyFile to Gossip

2016-04-24 Thread Carlos Rolo
As long as the topology doesn't change, yes. Repair once you finish. Em 24/04/2016 13:23, "AJ" escreveu: > Is it possible to do this without down time i.e. run in mixed mode while > doing a rolling upgrade? -- --

Changing snitch from PropertyFile to Gossip

2016-04-24 Thread AJ
Is it possible to do this without down time i.e. run in mixed mode while doing a rolling upgrade?

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-02 Thread Robert Coli
On Wed, Mar 2, 2016 at 7:21 AM, Arun Sandu wrote: > > All the nodes in both datacenters are in DSE Search Mode(Solr). We may > have analytics datacenter as well in future. Will this have any impact in > using Ec2MultiRegionSnitch? > This list does not support DSE, but as I understand it, they cre

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-02 Thread Arun Sandu
wrote: > >> All our nodes are launched in AWS EC2 VPC (private). We have 2 >> datacenters(1 us-east , 1- asiapacific) and all communication is through >> private IP's and don't have any public IPs. What is the recommended snitch >> to be used? We currently

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-02 Thread Arun Sandu
ic) and all communication is through >> private IP's and don't have any public IPs. What is the recommended snitch >> to be used? We currently have GossipingPropertyFileSnitch. >> >> 1. If Ec2MultiRegionSnitch, then what would be the broadcast_address? &g

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-01 Thread Robert Coli
On Tue, Mar 1, 2016 at 12:12 PM, Arun Sandu wrote: > All our nodes are launched in AWS EC2 VPC (private). We have 2 > datacenters(1 us-east , 1- asiapacific) and all communication is through > private IP's and don't have any public IPs. What is the recommended snitch > to

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-01 Thread Asher Newcomer
12 PM, Arun Sandu wrote: > Hi all, > > All our nodes are launched in AWS EC2 VPC (private). We have 2 > datacenters(1 us-east , 1- asiapacific) and all communication is through > private IP's and don't have any public IPs. What is the recommended snitch &

RE: Snitch for AWS EC2 nondefaultVPC

2016-03-01 Thread Jun Wu
ivate address, change broadcast address to public address, use Ec2MultiRegionSnitch. Hope it works! Date: Tue, 1 Mar 2016 15:12:04 -0500 Subject: Snitch for AWS EC2 nondefaultVPC From: arunsandu...@gmail.com To: user@cassandra.apache.org Hi all, All our nodes are launched in AWS EC2 VPC (private

Snitch for AWS EC2 nondefaultVPC

2016-03-01 Thread Arun Sandu
Hi all, All our nodes are launched in AWS EC2 VPC (private). We have 2 datacenters(1 us-east , 1- asiapacific) and all communication is through private IP's and don't have any public IPs. What is the recommended snitch to be used? We currently have GossipingPropertyFileSnit

Re: Pointers on deploying snitch for Multi region cluster

2015-03-09 Thread Robert Coli
On Mon, Mar 9, 2015 at 2:17 PM, Jan wrote: > c) Has anyone used "Gossiping_File_Property" snitch & got it working > successfully in a Multi region deployment. > Were I attempting the task you're doing, I'd use GPFS. =Rob

Pointers on deploying snitch for Multi region cluster

2015-03-09 Thread Jan
 HI Folks;  We are planning to deploy a Multi region C* Cluster with   nodes on both US coasts. Need some advice :  a)  As I do not have Public IP address access,  is there an alternative way to deploy EC2MultiRegion snitch using Private IP addresses ? b)  Has anyone used EC2_Snitch  with nodes

Re: EC2 Snitch load imbalance

2014-10-28 Thread Robert Coli
On Tue, Oct 28, 2014 at 3:35 AM, Oleg Dulin wrote: > I have a setup with 6 cassandra nodes (1.2.18), using RandomPartition, not > using vnodes -- this is a legacy cluster. > > We went from 3 nodes to 6 in the last few days to add capacity. However, > there appears to be an imbalance: > The first

Re: EC2 Snitch load imbalance

2014-10-28 Thread Oleg Dulin
Thanks Mark. The output in my original post is with keyspace specified. On 2014-10-28 12:00:15 +, Mark Reddy said: Oleg,  If you are running nodetool status, be sure to specify the keyspace also. If you don't specify the keyspace the results will be nonsense. https://issues.apache.org/

Re: EC2 Snitch load imbalance

2014-10-28 Thread Mark Reddy
Oleg, If you are running nodetool status, be sure to specify the keyspace also. If you don't specify the keyspace the results will be nonsense. https://issues.apache.org/jira/browse/CASSANDRA-7173 Regards, Mark On 28 October 2014 10:35, Oleg Dulin wrote: > I have a setup with 6 cassandra nod

EC2 Snitch load imbalance

2014-10-28 Thread Oleg Dulin
I have a setup with 6 cassandra nodes (1.2.18), using RandomPartition, not using vnodes -- this is a legacy cluster. We went from 3 nodes to 6 in the last few days to add capacity. However, there appears to be an imbalance: Datacenter: us-east == Replicas: 2 Address Rack

Re: which snitch ?

2014-10-26 Thread Colin
> ec2MultiRegion, it is failing since it is trying to invoking aws api on the > node inside the snitch. should I mention GossipingPropertyFileSnitch ? I am > not sure if I can mix and match. can someone advise me ? > > thx > srinivas > >> On Sat, Oct 25, 2014

Re: which snitch ?

2014-10-26 Thread Srinivas Chamarthi
what about for the nodes on the private cloud cluster ? if I mention, ec2MultiRegion, it is failing since it is trying to invoking aws api on the node inside the snitch. should I mention GossipingPropertyFileSnitch ? I am not sure if I can mix and match. can someone advise me ? thx srinivas On

Re: which snitch ?

2014-10-25 Thread Arun
Srinivas, Use ec2multiregion snitch. > On Oct 25, 2014, at 19:47, Srinivas Chamarthi > wrote: > > I am using a datacenter in private network and want to replicate data to an > ec2 data center. I am confused which snitch to use so that my data in the dc1 > is replicated to

which snitch ?

2014-10-25 Thread Srinivas Chamarthi
I am using a datacenter in private network and want to replicate data to an ec2 data center. I am confused which snitch to use so that my data in the dc1 is replicated to dc2 in ec2 ? any help is greatly appreciated thx srinivas

Re: Custom snitch classpath?

2014-06-20 Thread Marcelo Elias Del Valle
b/master/src/main/java/com/barchart/cassandra/plugins/snitch/GossipingPropertyFileWithEC2FallbackSnitch.java > > Basically it is a proxy that attempts to use GossipingPropertyFileSnitch, > and it that fails to initialize due to missing "rack" or "datacenter" > values, i

Re: Custom snitch classpath?

2014-06-20 Thread Jeremy Jongsma
Sharing in case anyone else wants to use this: https://github.com/barchart/cassandra-plugins/blob/master/src/main/java/com/barchart/cassandra/plugins/snitch/GossipingPropertyFileWithEC2FallbackSnitch.java Basically it is a proxy that attempts to use GossipingPropertyFileSnitch, and it that fails

Re: Custom snitch classpath?

2014-06-20 Thread Tyler Hobbs
The lib directory (where all the other jars are). bin/cassandra.in.sh does this: for jar in "$CASSANDRA_HOME"/lib/*.jar; do CLASSPATH="$CLASSPATH:$jar" done On Fri, Jun 20, 2014 at 12:58 PM, Jeremy Jongsma wrote: > Where do I add my custom snitch JAR to the Cassa

Custom snitch classpath?

2014-06-20 Thread Jeremy Jongsma
Where do I add my custom snitch JAR to the Cassandra classpath so I can use it?

Re: Multi-site Active-Active replication - Preparing Sites - Cluster Name and Snitch

2014-03-18 Thread Matthew Allen
1 >> xxx.yy.zzz.147=DC_NSW:rack1 >> xxx.yy.zzz.148=DC_NSW:rack1 >> ... and so forth for 9 nodes >> >> aaa.bb.ccc.144=DC_VIC:rack1 >> aaa.bb.ccc.145=DC_VIC:rack1 >> aaa.bb.ccc.146=DC_VIC:rack1 >> aaa.bb.ccc.147=DC_VIC:ra

Re: Multi-site Active-Active replication - Preparing Sites - Cluster Name and Snitch

2014-03-17 Thread Jonathan Lacefield
aaa.bb.ccc.146=DC_VIC:rack1 > aaa.bb.ccc.147=DC_VIC:rack1 > aaa.bb.ccc.148=DC_VIC:rack1 > ... and so forth for 9 nodes > > 5. Update App Keyspace to use NetworkTopologySnitch with > {'DC_NSW':5,'DC_VIC':5}. > > 6. Start standby cluster (V

Multi-site Active-Active replication - Preparing Sites - Cluster Name and Snitch

2014-03-16 Thread Matthew Allen
of Step 2 (after changing from Simple to NetworkTopologyStrategy) ? - Does the system keyspace snitch need to be updated to use NetworkTopologyStrategy as well ? As currently in the Lab it display as follows (please see 0.00% ownership below), or is this normal ? - Can the different sites run different m

Re: For Multi Datacenter Geo redundancy which snitch works better

2013-08-13 Thread Robert Coli
hosts in the future. As you are @rackspace.com, perhaps you do have this control. In that case, the RackInferringSnitch is probably fine. That said, anyone using a rack aware snitch should read : https://issues.apache.org/jira/browse/CASSANDRA-3810 =Rob

Re: For Multi Datacenter Geo redundancy which snitch works better

2013-08-13 Thread Ken Schell
lt;mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Cc: ken Schell mailto:ken.sch...@rackspace.com>> Subject: Re: For Multi Datacenter Geo redundancy which snitch works better On Mon, Aug 12, 2013 at 7:06 AM, Ken Schell mailto:ken.sch...@rackspace.com>> wrote: I

Re: For Multi Datacenter Geo redundancy which snitch works better

2013-08-12 Thread Robert Coli
On Mon, Aug 12, 2013 at 7:06 AM, Ken Schell wrote: > I'm building a two datacenter cluster for Geo redundancy, each with a > minimum of 12 nodes. > > Which Snitch would you recommend, PropertyFileSnitch or > RackInferringSnitch? > I'd probably use Gossip

For Multi Datacenter Geo redundancy which snitch works better

2013-08-12 Thread Ken Schell
Hello Everyone, I'm building a two datacenter cluster for Geo redundancy, each with a minimum of 12 nodes. Which Snitch would you recommend, PropertyFileSnitch or RackInferringSnitch? Our network addressing will support either method. All Keyspaces have a replication factor of 3 to 5,

Re: Determining Snitch at Runtime

2013-08-09 Thread Robert Coli
On Tue, Jul 30, 2013 at 8:46 AM, Ben Boule wrote: > It looks like I can infer this from the local table in the system schema > by looking at the datacenter value. > > Would this be a bad bad thing to do? > There used to be a way to set the snitch at runtime, but that appea

RE: Determining Snitch at Runtime

2013-07-30 Thread Ben Boule
@cassandra.apache.org Subject: Determining Snitch at Runtime Hi Everyone, Sorry if the answer to this question is out there, I can't seem to find it by searching. Is there a way to read the endpoint_snitch at runtime, preferably from a CQL query, but fine if it's available through an older API? (Or JM

Determining Snitch at Runtime

2013-07-30 Thread Ben Boule
eating clusters & provisioning our schema appropriately into them, it'd be great if the provisioning program could figure this out once it connected to the cluster before creating keyspaces. Right now we are having to track a maze of parameters to make sure that the cluster gets created with the

Re: Dynamic Snitch and EC2MultiRegionSnitch

2013-07-05 Thread Robert Coli
On Mon, Jul 1, 2013 at 2:35 PM, Daning Wang wrote: > How does dynamic snitch work with EC2MultiRegionSnitch? Can dynamic > routing only happen in one data center? We don't wan to have the requests > routed to another center even nodes are idle in other side since the > netw

Dynamic Snitch and EC2MultiRegionSnitch

2013-07-01 Thread Daning Wang
How does dynamic snitch work with EC2MultiRegionSnitch? Can dynamic routing only happen in one data center? We don't wan to have the requests routed to another center even nodes are idle in other side since the network could be slow. Thanks in advance, Daning

Re: has anyone used dynamic snitch at all

2013-03-11 Thread aaron morton
wing properties….(our properties show > PropertyFileSnitch though I see the keyspace has > org.apache.cassandra.locator.SimpleStrategy set probably because it was > created through a tool instead of CLI…shucks)….anyways, I still expected > dynamic snitch to work…. > > #

Re: has anyone used dynamic snitch at all

2013-03-08 Thread Edward Capriolo
cause it was > created through a tool instead of CLI…shucks)….anyways, I still expected > dynamic snitch to work…. > > # controls how often to perform the more expensive part of host score > # calculation > dynamic_snitch: true > dynamic_snitch_update_interval_in_ms: 10

has anyone used dynamic snitch at all

2013-03-08 Thread Hiller, Dean
because it was created through a tool instead of CLI…shucks)….anyways, I still expected dynamic snitch to work…. # controls how often to perform the more expensive part of host score # calculation dynamic_snitch: true dynamic_snitch_update_interval_in_ms: 100 # controls how often to reset all

Ec2Snitch and Ec2MultiRegionSnitch - does us-west-2 cause a bug with this snitch?

2011-11-14 Thread Allen Servedio
Hi, As of Nov. 9, 2011 Amazon added us-west-2 (US West Oregon) region: http://aws.typepad.com/aws/2011/11/now-open-us-west-portland-region.html In looking at the EC2Snitch code (in the 0.8.x and 1.0.x branches), I see it determining which data center (which I think is supposed to be equivalent to

Re: Ec2 snitch with network topology strategy

2011-06-29 Thread pankaj soni
Hmm... Just tested the config. It works, got confused with the options, my bad. On Wed, Jun 29, 2011 at 2:26 PM, pankajsoni0126 wrote: > I was thinking of leveraging ec2 snitch. But my question is then how do I > give replica placement options? > > Or can I give snitch as ec2snitch a

Ec2 snitch with network topology strategy

2011-06-29 Thread pankajsoni0126
I was thinking of leveraging ec2 snitch. But my question is then how do I give replica placement options? Or can I give snitch as ec2snitch and write the nodes cassandra-topology.prop and in give locator strategy at time of creating keyspace as network topology strategy. But will it work? And

Re: snitch & thrift

2011-06-16 Thread Jonathan Ellis
Seems like a more robust solution would be to implement dynamic-snitch-like behavior in the client. Hector has done this for a few months now. https://github.com/rantav/hector/blob/master/core/src/main/java/me/prettyprint/cassandra/connection/DynamicLoadBalancingPolicy.java On Thu, Jun 16, 2011

Re: snitch & thrift

2011-06-16 Thread Ryan King
On Thu, Jun 16, 2011 at 6:11 AM, Terje Marthinussen wrote: > Hi all! > Assuming a node ends up in GC land for a while, there is a good chance that > even though it performs terribly and the dynamic snitching will help you to > avoid it on the gossip side, it will not really help you much if thrift

snitch & thrift

2011-06-16 Thread Terje Marthinussen
Hi all! Assuming a node ends up in GC land for a while, there is a good chance that even though it performs terribly and the dynamic snitching will help you to avoid it on the gossip side, it will not really help you much if thrift still accepts requests and the thrift interface has choppy perform

Re: problems using property snitch file

2011-05-17 Thread aaron morton
will use default" {} will be the endpoint. Also during startup the snitch will log what it was able to read so you can check it is read what you think. I there is a problem with the topology that would probably explain the other error. If that does not fix it can you provide the keyspace

Re: Dynamic Snitch Problem

2011-05-17 Thread Jonathan Ellis
I guess otherwise it NPEs? Looks like a bug, can you open a ticket? On Tue, May 17, 2011 at 4:19 AM, Daniel Doubleday wrote: > Hi all > > after upgrading to 0.7 we have a small problem with dynamic snitch: > > we have rf=3, quorum read/write and read repair prop set to 0.

Dynamic Snitch Problem

2011-05-17 Thread Daniel Doubleday
Hi all after upgrading to 0.7 we have a small problem with dynamic snitch: we have rf=3, quorum read/write and read repair prop set to 0. Thus cassandra always shortcuts reads to only 2 hosts. Problem is that one of our nodes get ignored unless using a little patch and initialize the scores

Re: problems using property snitch file

2011-05-16 Thread Anurag Gujral
loper >> @aaronmorton >> http://www.thelastpickle.com >> >> On 14 May 2011, at 11:48, Anurag Gujral wrote: >> >> > Hi All, >> > I have built a cassandra cluster which is using property >> snitch file to specify my network topology to ca

Re: problems using property snitch file

2011-05-16 Thread aaron morton
--- > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 14 May 2011, at 11:48, Anurag Gujral wrote: > > > Hi All, > > I have built a cassandra cluster which is using property snitch > > file

Re: problems using property snitch file

2011-05-15 Thread Anurag Gujral
e Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 14 May 2011, at 11:48, Anurag Gujral wrote: > > > Hi All, > > I have built a cassandra cluster which is using property snitch > file to specify my network topology to cassandra.

Re: problems using property snitch file

2011-05-15 Thread aaron morton
using property snitch > file to specify my network topology to cassandra.The keyspace I have use > network topology strategy. > > When I tried to add new node to this cluster,I get the following error: > RROR [main] 2011-05-13 23:45:44,152 AbstractCassandraDaemon.java (line 333) &g

problems using property snitch file

2011-05-13 Thread Anurag Gujral
Hi All, I have built a cassandra cluster which is using property snitch file to specify my network topology to cassandra.The keyspace I have use network topology strategy. When I tried to add new node to this cluster,I get the following error: RROR [main] 2011-05-13 23:45:44,152

Re: EC2 Snitch

2011-05-11 Thread Vijay
DC and RAC only thing is that we have to allow IP's in the security groups to talk to each other's region. Regards, On Tue, May 10, 2011 at 6:19 PM, Sameer Farooqui wrote: > Has anybody successfully used EC2 Snitch for cross-region deployments on > EC2? Brandon Williams has

Re: Read time get worse during dynamic snitch reset

2011-05-11 Thread shimi
up of the dynamic snitch > http://www.mail-archive.com/user@cassandra.apache.org/msg12092.html The > RackInferringSnitch (and the PropertyFileSnitch) derive from the > AbstractNetworkTopologySnitch and should... > " > In the case of the NetworkTopologyStrategy, it inh

EC2 Snitch

2011-05-10 Thread Sameer Farooqui
Has anybody successfully used EC2 Snitch for cross-region deployments on EC2? Brandon Williams has not recommended using this just yet, but I was curious if anybody is using it with 0.8.0. Also, the snitch just let's the cluster automatically discover what the different regions (aka data ce

Re: Read time get worse during dynamic snitch reset

2011-04-12 Thread aaron morton
Something feels odd. From Peters nice write up of the dynamic snitch http://www.mail-archive.com/user@cassandra.apache.org/msg12092.html The RackInferringSnitch (and the PropertyFileSnitch) derive from the AbstractNetworkTopologySnitch and should... " In the case o

Re: Read time get worse during dynamic snitch reset

2011-04-11 Thread shimi
ng does the bad performance last for? > Only a few seconds and but there are a lot of read requests during this time > > What CL are you reading at ? At Quorum with RF 4 the read request will be > sent to 3 nodes, ordered by proximity and wellness according to the dynamic > snitch. (for b

Re: Read time get worse during dynamic snitch reset

2011-04-11 Thread aaron morton
RF 4 the read request will be sent to 3 nodes, ordered by proximity and wellness according to the dynamic snitch. (for background recent discussion on dynamic snitch http://www.mail-archive.com/user@cassandra.apache.org/msg12089.html) You can take a look at the weights and timings used by the

Read time get worse during dynamic snitch reset

2011-04-11 Thread shimi
thing that I know that is running every 10 minutes is the dynamic snitch reset. So I changed dynamic_snitch_reset_interval_in_ms to 20 minutes and now I have the problem once in every 20 minutes. I am running all nodes with: replica_placement_strategy

0.7.4 problems .. snitch?

2011-03-22 Thread Sasha Dolgy
Hi there, Installed a new 4 node 0.7.4 cluster on ec2. Brought up the first node without issue with Ec2Snitch configured in the cassandra.yaml. Brought up a second node, with the first node defined as the seed. No visible issues. 3 & 4 however are giving me problems as shown in the output belo

Re: Dynamic Snitch / Read Path Questions

2010-12-17 Thread Daniel Doubleday
> the purpose of your thread is: How far are you away from being I/O > bound (say in terms of % utilization - last column of iostat -x 1 - > assuming you don't have a massive RAID underneath the block device) No my cheap boss didn't want to by me a stack of these http://www.ocztechnology.com/prod

Re: Dynamic Snitch / Read Path Questions

2010-12-14 Thread Peter Schuller
> We are entirely IO-bound. What killed us last week were to many reads > combined with flushes and compactions. Reducing compaction priority helped > but it was not enough. Them main problem why we could not add nodes though > had to do with the quorum reads we are doing: I'm going to respond

Re: Dynamic Snitch / Read Path Questions

2010-12-14 Thread Daniel Doubleday
e would send one to itself. As far as I understand it the MessagingService is always user in the strong read path. Local messages will be shortcutted transport-wise but MessageDeliveryTask will still be used which in turn calls the ResponseVerbHandler which notifies the snitch about latencies. I

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Brandon Williams
On Mon, Dec 13, 2010 at 6:43 PM, Daniel Doubleday wrote: > Oh - well but I see that the coordinator is actually using its own score > for ordering. I was only concerned that dropped messages are ignored when > calculating latencies but that seems to be the case for local or remote > responses. And

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Daniel Doubleday
using |-Dcassandra.dynamic_snitch=true for the read path |and that's what I came up with: 1) If using CL > 1 than using the dynamic snitch will result in a data read from node with the lowest latency (little simplified) even if the proxy node contains the data but has a

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Brandon Williams
s what I came > up with: > > 1) If using CL > 1 than using the dynamic snitch will result in a data read > from node with the lowest latency (little simplified) even if the proxy node > contains the data but has a higher latency that other possible nodes which > means that it is

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Daniel Doubleday
seResolver would be satisfied without waiting for the slowest node. I think that's what's supposed to happen when using the dynamic snitch without any code change. And that was the point of question 1) in my last mail. question 2) is important to me because in the future we might want

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Peter Schuller
> 1) If using CL > 1 than using the dynamic snitch will result in a data read > from node with the lowest latency (little simplified) even if the proxy node > contains the data but has a higher latency that other possible nodes which > means that it is not necessary to do load-bas

Dynamic Snitch / Read Path Questions

2010-12-12 Thread Daniel Doubleday
Hi again. It would be great if someone could comment whether the following is true or not. I tried to understand the consequences of using |-Dcassandra.dynamic_snitch=true for the read path |and that's what I came up with: 1) If using CL > 1 than using the dynamic snitch will res

Re: Fatal error: Error instantiating snitch class 'org.apache.cassandra.locator.SimpleSnitch'.

2010-10-29 Thread Gary Dusbabek
There's not a lot of useful information in that error. Cassandra consumes the stack trace and any exceptions underneath that cause the error instantiating the snitch. I've created https://issues.apache.org/jira/browse/CASSANDRA-1682 so we can include a full stack trace. In the meantim

Fatal error: Error instantiating snitch class 'org.apache.cassandra.locator.SimpleSnitch'.

2010-10-29 Thread Jérôme Verstrynge
Fatal error: Error instantiating snitch class 'org.apache.cassandra.locator.SimpleSnitch'. Bad configuration; unable to start server Googling does not return much information. Does anyone know what is happening? Thanks, JVerstry P.S.: It is very late here -> going to bed and will read answers tomorrow.

Re: Cassandra Chef recipe and EC2 snitch

2010-07-25 Thread Benjamin Black
the link mentions an ec2snitch, but i don't. the cookbook can just generate property files for the propertysnitch (which i much prefer to the use of a dedicated snitch). the algorithm for decided locality is at least as dumb as the one in the rack-aware snitch. on the plus side, it

Re: Cassandra Chef recipe and EC2 snitch

2010-07-22 Thread Dave Viner
You don't need the ec2snitch necessarily. AFAIK, It's meant to be a "better" way of detecting where your ec2 instances are. But, unless you're popping instances all the time, I don't think it's worth it. Check out the step-by-step guide on that same page. Pure EC2 api calls to setup your cluste

Cassandra Chef recipe and EC2 snitch

2010-07-22 Thread Allan Carroll
Hi all, I'm setting up a new cluster on EC2 for the first time and looking at the wiki cloud setup page (http://wiki.apache.org/cassandra/CloudConfig). There's a chef recipe linked there that mentions an ec2snitch. The link doesn't seem to go where it says it does. Does anyone know where those

Re: Property file snitch for Cassandra?

2010-07-07 Thread Dave Viner
After more investigation, as well as a bunch of trial and error, here's what seems to be happening. 1. The rack.properties file key values (the stuff before the =) must match the toString() method of the InetAddress object for the host. 2. (In EC2) the InetAddress of a node *other* than the one yo

Re: Property file snitch for Cassandra?

2010-07-07 Thread Eric Evans
Let's move this to the user@ list... On Wed, 2010-07-07 at 16:32 -0700, Dave Viner wrote: > After starting up my cluster, I see this one of the system.log : > > > ERROR [GMFD:1] 2010-07-07 23:27:46,044 PropertyFileEndPointSnitch.java > (line 91) Could not find end point information for /10.202