Re: Error while adding a new node.

2015-06-30 Thread Arun
Looks like you have too many open files issue. Increase the ulimit for the user. If you are starting the cassandra daemon using user cassandra, increase the ulimit for that user. > On Jun 30, 2015, at 21:16, Neha Trivedi wrote: > > Hello, > I have a 4 node cluster with SimpleSnitch. > Cassan

Re: High Compactions Pending

2014-09-22 Thread Arun
does it drop down shortly after? > > --- > Chris Lohfink > >> On Sep 22, 2014, at 7:57 PM, arun sirimalla wrote: >> >> I have a 6 (i2.2xlarge) node cluster on AWS with 4.5 DSE running on it. I >> notice high compaction pending on one of the node around 35. >&g

Re: which snitch ?

2014-10-25 Thread Arun
Srinivas, Use ec2multiregion snitch. > On Oct 25, 2014, at 19:47, Srinivas Chamarthi > wrote: > > I am using a datacenter in private network and want to replicate data to an > ec2 data center. I am confused which snitch to use so that my data in the dc1 > is replicated to dc2 in ec2 ? any

Need ur expertise on Cassandra issue!!

2014-01-11 Thread Arun
persists. we need your expertise to comment on this production issue.please let me know if you need any information!! I will wait for your response !! -Arun

Cassandra monitoring

2016-06-14 Thread Arun Ramakrishnan
having opscenter offsets all the improvements that have been added to cassandra since 2.1. Sematext has a integrations for monitoring cassandra. Does anyone have good experience with it ? How much work would be involved to setup Ganglia or some such option for cassandra ? Thanks, Arun

Re: Cassandra monitoring

2016-06-14 Thread Arun Ramakrishnan
a non-good reason. > > What else do you use for monitoring in your infra? I've used a mix of OSS > tools (nagios, statsd, graphite, ELK), and hosted solutions. The nice part > about them is that you can monitor your whole stack in a single UI not just > your database.

Kafka(9.0.1) error : org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 1164731757 larger than 104857600)

2016-10-18 Thread Arun Rai
857600 socket.receive.buffer.bytes=1048576 socket.send.buffer.bytes=1048576 queued.max.requests=16 fetch.purgatory.purge.interval.requests=100 producer.purgatory.purge.interval.requests=100 Any help will be really appreciated. Arun Rai

Re: Read Consistency

2015-06-23 Thread arun sirimalla
the only node having data is > returned? > > Scenario 2: Read query is fired and all 3 replicas have different data > with different timestamps. > > Options: data with latest timestamp is returned OR something else??? > > Thanks > Anuj > > Sent from Yahoo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > -- Arun

Re: Read Consistency

2015-06-23 Thread arun sirimalla
ail if doesnt find data.. >> >> Not convinced.. >> >> Sent from Yahoo Mail on Android >> <https://overview.mail.yahoo.com/mobile/?.src=Android> >> -- >> *From*:"arun sirimalla" >> *Date*:Tue, 23 Jun, 2015 at 11:

Re: Read Consistency

2015-06-23 Thread arun sirimalla
Thanks good to know that. On Tue, Jun 23, 2015 at 11:27 AM, Philip Thompson < philip.thomp...@datastax.com> wrote: > Yes, that is what he means. CL is for how many nodes need to respond, not > agree. > > On Tue, Jun 23, 2015 at 2:26 PM, arun sirimalla > wrote: > >>

Re: 10000+ CF support from Cassandra

2015-06-24 Thread Arun Chaitanya
any ideas or advises? On Mon, Jun 22, 2015 at 10:55 AM, Arun Chaitanya wrote: > Hello All, > > Now we settled on the following approach. I want to know if there are any > problems that you foresee in the production environment. > > Our Approach: Use Off Heap Memory &g

Re: 10000+ CF support from Cassandra

2015-06-24 Thread Arun Chaitanya
o I do not want to enter this territory. Sorry for such questions, but I am still wondering if I am the only one facing this problem. Thanks a lot, Arun On Wed, Jun 24, 2015 at 10:28 PM, Jack Krupansky wrote: > By entries, do you mean rows or columns? Please clarify how many columns >

Re: Is it okay to use a small t2.micro instance for OpsCenter and use m3.medium instances for the actual Cassandra nodes?

2015-06-26 Thread arun sirimalla
can I have 3 m3.medium nodes for Cassandra and 1 > t2.micro node for OpsCenter? > > -- Arun Senior Hadoop/Cassandra Engineer Cloudwick 2014 Data Impact Award Winner (Cloudera) http://www.cloudera.com/content/cloudera/en/campaign/data-impact-awards.html

Cassandra -stress write - Storage location

2015-10-29 Thread Arun Sandu
10.34.100.13 -- Thanks Arun

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Arun Sandu
Thanks . Can I know, the format of the data that gets stored? Can you please suggest me some ways to perform load testing? I need a big picture of all the statistics. Thanks again Arun On Thu, Oct 29, 2015 at 9:41 PM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > By def

Keyspaces missing after restarting cassandra service

2015-11-02 Thread Arun Sandu
cqlsh? Can someone help me with a solution? -- Thanks&Regards Arun

Hints timed out

2015-11-20 Thread Arun Sandu
:140 - Got error, removing parent repair session ERROR [AntiEntropyStage:2] 2015-11-20 14:10:58,825 CassandraDaemon.java:222 - Exception in thread Thread[AntiEntropyStage:2,5,main] Can someone help me understand the issues? Thanks Arun

Snitch for AWS EC2 nondefaultVPC

2016-03-01 Thread Arun Sandu
1/cassandra/configuration/configCassandra_yaml_r.html#reference_ds_qfg_n1r_1k__broadcast_address> to the *public* IP address of the node. -- Thanks Arun

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-02 Thread Arun Sandu
Newcomer wrote: > Hi Arun, > > This distinction has been a can of worms for me also - and I'm not sure my > understanding is entirely correct. > > I use GossipingPropertyFileSnitch for my multi-region setup, which seems > to be more flexible than the Ec2 snitches. The Ec2 snitch

Re: Snitch for AWS EC2 nondefaultVPC

2016-03-02 Thread Arun Sandu
Thanks Robert, All the nodes in both datacenters are in DSE Search Mode(Solr). We may have analytics datacenter as well in future. Will this have any impact in using Ec2MultiRegionSnitch? On Tue, Mar 1, 2016 at 7:10 PM, Robert Coli wrote: > On Tue, Mar 1, 2016 at 12:12 PM, Arun Sandu >

High Compactions Pending

2014-09-22 Thread arun sirimalla
I have a 6 (i2.2xlarge) node cluster on AWS with 4.5 DSE running on it. I notice high compaction pending on one of the node around 35. Compaction throughput set to 64 MB and flush writes to 4. Any suggestion is much appreciated. -- Arun Senior Hadoop Engineer Cloudwick Champion of Big Data

Re: Best Practice to add a node in a Cluster

2015-04-27 Thread arun sirimalla
t;>> We have a 2 Cluster Node with RF=2. We are planing to add a new node. >>> >>> Should we change RF to 3 in the schema? >>> OR Just added a new node with the same RF=2? >>> >>> Any other Best Practice that we need to take care? >>> >>> Thanks >>> regards >>> Neha >>> >>> >> > -- Arun Senior Hadoop/Cassandra Engineer Cloudwick Champion of Big Data (Cloudera) http://www.cloudera.com/content/dev-center/en/home/champions-of-big-data.html 2014 Data Impact Award Winner (Cloudera) http://www.cloudera.com/content/cloudera/en/campaign/data-impact-awards.html

Re: calculation of disk size

2015-04-29 Thread arun sirimalla
google.com/store/apps/details?id=com.indiamart.m> > <http://m.indiamart.com/> > > <https://www.youtube.com/watch?v=DzORNbeSXN8&list=PL2o4J51MqpL0mbue6kzDa6eymLVUXtlR1&index=2> > Watch how IndiaMART Maximiser helped Mr. Khanna expand his business. > kyunki

Re: Can a Cassandra node accept writes while being repaired

2015-05-07 Thread arun sirimalla
nternet so I am asking this question here. > Is a Cassandra node able to accept insert or delete operations while the > node is being repaired? > Thanks > -Razi > -- Arun Senior Hadoop/Cassandra Engineer Cloudwick Champion of Big Data (Cloudera) http://www.cloudera.com/content/d

Re: Unexpected behavior after adding successffully a new node

2015-05-12 Thread arun sirimalla
2e0aab6598e 1c > UN 10.0.0.c 40.61 MB 256 64.9% > b8da952c-24b3-444a-a34e-7a1804eee6e6 1c > > What do you recommend to do? Leave this as if, remove it and try to join > this or a new one? > Thanks in advance!! > > -- > Saludos / Regards. > > Analía Lorenzatto

10000+ CF support from Cassandra

2015-05-26 Thread Arun Chaitanya
infrastructure. Is this the right approach? Any suggestion is appreciated. Thanks, Arun

Re: 10000+ CF support from Cassandra

2015-05-26 Thread Arun Chaitanya
ks a lot for your insight. Anyways my previous questions still remain unclear for me. Arun On Wed, May 27, 2015 at 11:40 AM, graham sanderson wrote: > Are the CFs different, or all the same schema? Are you contractually > obligated to actually separate data into separate CFs? It seems like

Re: EC2snitch in AWS

2015-05-27 Thread arun sirimalla
on which has availability zone 1a and 1b? I am using Cassandra > version 1.2.19 in the setup. > > I would appreciate your help. > > Regards, > > Kaushal > -- Arun Senior Hadoop/Cassandra Engineer Cloudwick 2014 Data Impact Award Winner (Cloudera) http://www.cloudera.c

Re: 10000+ CF support from Cassandra

2015-05-27 Thread Arun Chaitanya
our organization's customers has their data segregated, or does each customer have direct access to the cluster? Each organization's data is in the same cluster. No customer doesn't have access to the cluster. Thanks, Arun On Wed, May 27, 2015 at 7:17 PM, Jack Krupansky wrote: >

Re: 10000+ CF support from Cassandra

2015-06-01 Thread Arun Chaitanya
rs", but did you mean 10 nodes? You might want > to consider a model where you do indeed have multiple clusters, where each > handles a fraction of the tenants, since there is no need for separate > tenants to be on the same cluster. > > > -- Jack Krupansky > > On Tue,

Re: nodetool repair

2015-06-18 Thread arun sirimalla
epair all the nodes >> in the cluster or only the one on which we issue the command? >> >> If it repairs only one node, do I have to wait that the nodetool repair >> ends, and only then issue another “nodetool repair” on the next node? >> >> If we had down time per

Re: nodetool repair

2015-06-19 Thread arun sirimalla
t. > > If it does a compaction, does it mean that it would also clean up my > tombstone from my LeveledCompactionStrategy tables at the same time? > > Thanks for your help. > > On 19 Jun 2015, at 07:56 , arun sirimalla wrote: > > Hi Jean, > > Running nodetool repair

Re: 10000+ CF support from Cassandra

2015-06-21 Thread Arun Chaitanya
media.tumblr.com/5d0efca7288dc969c1ac4fc3d36e0151/tumblr_inline_mzvj254quj1rd24f4.png > > About an order of magnitude difference in performance. > > Jon > > On Mon, Jun 1, 2015 at 7:20 PM Arun Chaitanya > wrote: > >> Thanks Jon and Jack, >> >> > I strongl

question on capacity planning

2011-06-29 Thread Jacob, Arun
ble merges? Given this amount of data, would you recommend node storage at 2TB per node or more? This application will have a heavy write /moderate read use profile. -- Arun

Cassandra Node Requirements

2011-08-24 Thread Jacob, Arun
ld be doing? 3. Assuming I'm not using SSDs, what would be a good memory size for a node? I've heard anything from 32-48 GB, but need more guidance. Anything else that anyone has run into? What are common configurations being used by others? Thanks in advance, -- Arun

Re: Cassandra Node Requirements

2011-08-24 Thread Jacob, Arun
age ratio: I'm assuming that ratio trends higher with the more random reads you do. Could you provide an example ratio for a heavy read use case? Thanks, -- Arun From: Edward Capriolo mailto:edlinuxg...@gmail.com>> Reply-To: "user@cassandra.apache.org<mailto:user@cassan

Re: Solandra distributed search

2011-10-06 Thread Jacob, Arun
does the Solandra specific partitioner distribute data relatively equally across nodes? Is this influenced by the shards.at.once property? If I'm writing to 3 nodes, how would the default setting of 4 for this property affect the distribution of data across my nodes? From: Jake Luciani mailt

Solandra: connection refused errors

2011-10-06 Thread Jacob, Arun
I'm seeing this error when trying to insert data into a core I've defined in Solandra INFO [pool-7-thread-319] 2011-10-06 16:21:34,328 HttpMethodDirector.java (line 445) Retrying request INFO [pool-7-thread-1070] 2011-10-06 16:21:34,328 HttpMethodDirector.java (line 445) Retrying request INFO [

invalid shard name encountered

2011-10-06 Thread Jacob, Arun
I'm seeing this in my logs: WARN [1832199239@qtp-673795938-0] 2011-10-06 16:15:46,424 CassandraIndexManager.java (line 364) invalid shard name encountered: WDPRO-NGELOG-DEV 1 WDPRO-NGELOG-DEV is the name of the index I'm creating. Is there a restriction on characters in the name?

After deleting some data from the cluster under Solandra, we keep seeing this assertion.

2011-11-11 Thread Jacob, Arun
After removing some data from Solandra via a Solr query, we are getting DecoratedKey assertions. Our setup: latest version of Solandra (I think it supports 0.8.6, please correct if wrong) 3 solandra nodes, with replication set to 2 and sharding set to 3. No systems are currently running (ingest

Cassandra for Ad-hoc Aggregation and formula calculation

2010-12-10 Thread Arun Cherian
hoice (calculating aggregation per 1 min, 5 min, 15 min etc ahead of time) but in case we need ad-hoc aggregation, does Cassandra support that over this amount of data? Thanks, Arun

Re: Scala Dataframe - spark.cassandra.sql.pushdown.additionalClasses not working

2024-07-10 Thread Arun Vigesh
On Wed, Jul 10, 2024 at 8:49 PM Arun Vigesh wrote: > Hi > > I am encountering a Singleton object not available error when trying to > add the parameter *spark.cassandra.sql.pushdown.additionalClasses* to > push all filters to Cassandra. Please find the code and error message b

Error - Scala Dataframe - spark.cassandra.sql.pushdown.additionalClasses

2024-07-10 Thread Arun Vigesh
Hi I am encountering a *Singleton object not available *error when trying to add the parameter *spark.cassandra.sql.pushdown.additionalClasses* to push all filters to Cassandra. Please find the code and error message below: *Code:* package com.common.reader import org.apache.spark.sql.{DataFram

Opscenter's Meaning of 'Requests'

2013-12-30 Thread Arun Kumar K
on perspective an operation means differently for both column families. Can some one guide me ? Thanks, Arun

Opscenter Metrics

2013-12-30 Thread Arun Kumar K
1> What does an 'operation or request' mean from opscenter perspective? 2> Does it mean unique row inserts across all column families ? or Does it mean count of each mutations for a row ? Can some one guide me ? Thanks, Arun

Re: Opscenter Metrics

2014-01-03 Thread Arun Kumar K
tly-mean > > On Tue, Dec 31, 2013 at 12:55 AM, Arun Kumar K wrote: > >> Hi guys, >> >> I am using YCSB and using thrift based *client.batch_mutate()* call. >> >> Now say opscenter reports the "write requests" as say 1000 *operations*/sec >>