Re: Cassandra is consuming a lot of disk space

copy all the contents in the table directory to one of the drives? Thanks for all the help. Regards, Rahul On Thursday 14 January 2016, Rahul Ramesh wrote: > Hi Jan, > I checked it. There are no old Key Spaces or tables. > Thanks for your pointer, I started looking inside the directori

Re: Cassandra is consuming a lot of disk space

ce is consuming > your space. > > Jan > > Von meinem iPhone gesendet > > Am 14.01.2016 um 07:25 schrieb Rahul Ramesh : > > Thanks for your suggestion. > > Compaction was happening on one of the large tables. The disk space did > not decrease much after the compact

Re: Cassandra is consuming a lot of disk space

t; sstables that have been compacted away. You can verify by doing lsof and >>> grepping for DEL or deleted. >>> >>> If it's not that, you can run nodetool cleanup on each node to scan all >>> of the sstables on disk and remove anything that it's not res

Cassandra is consuming a lot of disk space

We have a 2 node Cassandra cluster with a replication factor of 2. The load factor on the nodes is around 350Gb Datacenter: Cassandra == Address RackStatus State LoadOwns Token -5072018636360415943 172.31.7.91 rack1 Up Normal 328.5 GB100.00

Re: NetworkTopologyStrategy ring distribution across 2 DC

Thanks. The error is gone if i specify the keyspace name. However the replicas in the ring output is not correct. Shouldn't it say 3 because I have DC1:3, DC2:3 in my schema? thanks Ramesh Datacenter: DC1 == Replicas: 2 AddressRackStatus State Load

Fwd: NetworkTopologyStrategy ring distribution across 2 DC

is 0% for the second DC. Is this normal? thanks Ramesh # /opt/mp/storage/persistent/cassandra-dse/bin/nodetool -h cassandra101 ring Note: Ownership information does not include topology; for complete information, specify a keyspace Datacenter: DC1 == AddressRackStatus St

Re: Sample Trigger Code to get inserted value

umn comparator type. If we want to write generic trigger code, we can use cf.getComponentComparator()/getKeyValidator(). - Ramesh On Wed, Nov 27, 2013 at 5:10 PM, J Ramesh Kumar wrote: > Hi, > > I need your help on extract column names and values in the trigger augment > method. &g

Sample Trigger Code to get inserted value

} } I tried my best to search sample code in google. But failed. Please help me with sample code. Thanks in advance. Regards, Ramesh

Re: Unable to load dependent classes of a trigger

Hi, The trace printed because I enabled "debug". But actually my custom classes are loaded successfully with that jar. The exception make me confusion. This is FYI. Thanks, Ramesh On Tue, Nov 26, 2013 at 4:55 PM, J Ramesh Kumar wrote: > Hi, > > I wrote a trigger and it w

Unable to load dependent classes of a trigger

Hi, I wrote a trigger and it will call internally some other classes. I added all the dependent classes into a jar and put it into the "*conf/tiggers*". But cassandra does not load the dependent classes which available in the jar. How can Solve this issue ? Thanks, Ramesh Traces whic

Help on Cassandra Limitaions

Hi, http://wiki.apache.org/cassandra/CassandraLimitations In the above link, I found the below limitation, "The maximum number of cells (rows x columns) in a single partition is 2 billion.". Here what does "partition" mean ? Is it node (or) column family (or) anything else ? Thanks, Ramesh

Re: unable to nodetool to remote EC2

2 5612956  On Mon, May 21, 2012 at 11:00 PM, ramesh <dbgroup...@gmail.com> wrote: On 05/21/2012 03:55 AM

Re: unable to nodetool to remote EC2

Tel:   +972 2 6409736  Mob:  +972 54 8356490  Fax:   +972 2 5612956  On Fri, May 18, 2012 at 9:49 PM, ramesh <dbgroup...@gmail.

Re: unable to nodetool to remote EC2

up something like this: http://simplygenius.com/2010/08/jconsole-via-socks-ssh-tunnel.html On Fri, May 18, 2012 at 1:31 PM, ramesh <mailto:dbgroup...@gmail.com>> wrote: I updated the cassandra-env.sh $JMX_HOST="10.20.30.40" JVM_OPTS="$JVM_OPTS -Djava.rm

Re: unable to nodetool to remote EC2

up something like this: http://simplygenius.com/2010/08/jconsole-via-socks-ssh-tunnel.html On Fri, May 18, 2012 at 1:31 PM, ramesh <mailto:dbgroup...@gmail.com>> wrote: I updated the cassandra-env.sh $JMX_HOST="10.20.30.40" JVM_OPTS="$JVM_OPTS -Djava.rm

unable to nodetool to remote EC2

ket(TCPEndpoint.java:595) ... 10 more Any help appreciated. Regards Ramesh

Does or will Cassandra support OpenJDK ?

rious to know if I would be able to avoid the pain of using Sun JDK in future for production Cassandra ? regards Ramesh

datastax opscenter authentication

I am trying to integrate opscenter in our environment and I was wondering if we can use PAM authentication instead of a password file for opscenter authentication? thanks Ramesh

Re: specifying initial cassandra schema

Thanks and appreciate the responses. Will look into this. thanks Ramesh On Wed, Jan 18, 2012 at 2:27 AM, aaron morton wrote: > check the command line help for cassandra-cli, you can pass it a file name. > > e.g. cassandra --host localhost --file schema.txt &

specifying initial cassandra schema

cassandra as a part of OS boot up. I saw some old references to specify schema in cassandra.yaml. Is this still supported in Cassandra 1.x? Are there any examples? thanks Ramesh

Re: gracefully recover from data file corruptions

rises. thanks Ramesh On Fri, Dec 16, 2011 at 12:48 PM, Ben Coverston wrote: > Hi Ramesh, > > Every time I have seen this in the last year it has been caused by bad > hardware or bad memory. Usually we find errors in the syslog. > > Jeremiah is right about running repair when you

gracefully recover from data file corruptions

nable gossip so all pending hintedhandoff occurs - enable thrift. Thanks Ramesh

Re: tmp files in /var/lib/cassandra/data

       0   > 155320746 /opt/cassandra/data/system/HintsColumnFamily-tmp-hc-1107-Index.db > java       8185      root  955u      REG               8,32          0   > 155320747 /opt/cassandra/data/system/HintsColumnFamily-tmp-hc-1107-Data.db > > Going to try rolling back to 1.0.5 for the tim

tmp files in /var/lib/cassandra/data

We are using leveled compaction running cassandra 1.0.6. I checked the data directory (/var/lib/cassandra/data) and i see these 0 bytes tmp files. What are these files? thanks Ramesh -rw-r--r-- 1 root root0 Dec 14 17:15 uid-tmp-hc-106-Data.db -rw-r--r-- 1 root root0 Dec 14 17

Re: cassandra in production environment

n JRE 1.6.29 thanks Ramesh On Mon, Dec 12, 2011 at 10:02 AM, Jason Wellonen wrote: > RHEL 6.1 and 6.2 with KVM.  No file corruptions that I am aware of. > > Jason > > -Original Message- > From: Ramesh Natarajan [mailto:rames...@gmail.com] > Sent: Sunday, December 1

cassandra in production environment

Hi, We are currently testing cassandra in RHEL 6.1 64 bit environment running on ESXi 5.0 and are experiencing issues with data file corruptions. If you are using linux for production environment can you please share which OS/version you are using? thanks Ramesh

Re: IOException running cassandra 1.0.5

ce it has been written, so this would > suggest an external modification, typically some bit rot. > > In that case you don't have much other choice than removing > the mentioned data file and run a repair. > > -- > Sylvain > > On Fri, Dec 9, 2011 at 1:37 PM, Ramesh Na

Re: AssertionError in hintedhandoff - 1.0.5

https://issues.apache.org/jira/browse/CASSANDRA-3579 thanks Ramesh On Tue, Dec 6, 2011 at 2:16 AM, Sylvain Lebresne wrote: > Do you mind opening a ticket on > https://issues.apache.org/jira/browse/CASSANDRA ? > > Thanks > > -- > Sylvain > > On Tue, Dec 6, 2011 at

Re: Assertion error during bootstraping cassandra 1.0.2

https://issues.apache.org/jira/browse/CASSANDRA-3536 thanks Ramesh On Mon, Nov 28, 2011 at 5:59 AM, Sylvain Lebresne wrote: > I don't think you're doing anything wrong. Would you mind opening a ticket > on JIRA (https://issues.apache.org/jira/browse/CASSANDRA) ? > > -- >

Assertion error during bootstraping cassandra 1.0.2

doing anything wrong here? thanks Ramesh [root@CAP4-CNode4 cassandra]# INFO 10:29:46,093 Logging initialized INFO 10:29:46,099 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_25 INFO 10:29:46,100 Heap size: 8304721920/8304721920 INFO 10:29:46,100 Classpath: bin/../conf:bin

Re: Internal error processing get: Null pointer exception

Are we doing anything wrong here? or can this be a bug in cassandra? thanks Ramesh On Tue, Nov 1, 2011 at 11:02 PM, Jonathan Ellis wrote: > That doesn't make sense to me.  CS:147 is > >            columnFamilyKeyMap.put(row.key, row.cf); > > where cFKM is > >        Ma

Re: Second Cassandra users survey

take advantage of the Column Bloom Filter and it is not always easy to enumerate the column names in a deterministic manner. - provide JNA support for Key cache - remove dependency on running node tool repair when any column is deleted ( so tombstones doesn't get resurrected ) thanks Ramesh

Re: Cassandra 1.0: Exception in compaction

No Unfortunately I don't have the log files , the system was scratch loaded. Thanks Ramesh Sylvain Lebresne wrote: >You don't have the full logs of a node leading to the exception by any change ? >Especially one that leads to a > java.lang.IllegalArgumentException: I

Re: Cassandra 1.0: Exception in compaction

We are using the final 1.0.0. Thanks Ramesh On Wed, Oct 26, 2011 at 11:16 AM, Sylvain Lebresne wrote: > Also, to be sure, were you using the 1.0.0 final or some RC when getting this > exception? > > On Fri, Oct 21, 2011 at 8:24 PM, Sylvain Lebresne > wrote: >> Would you

Re: Key count mismatch in cluster for a column family

environment? Are there any known issues/interactions with compaction and updating column family in 1.0? Thanks Ramesh Ramesh Natarajan wrote: >Looks like compaction for this column family stopped after some time. >The last message for this column family in the system.log is >

Re: Key count mismatch in cluster for a column family

te = true and row_cache_provider = 'SerializingCacheProvider' and compaction_strategy = 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy' and compaction_strategy_options = {'sstable_size_in_mb' : '10'}; Any idea why compaction stopped automatically for thi

Re: nodetool ring Load column

I don't use compressed sstable. I also use the default compaction strategy. i will look at JIRA and see if there are any similarities. thanks Ramesh On Fri, Oct 21, 2011 at 6:51 AM, Jeremiah Jordan wrote: > Are you using compressed sstables? or the leveled sstables?  Make sure you &

Re: Cassandra 1.0: Exception in compaction

i am using size based compaction ( the default one ). Also this is on linux. thanks Ramesh On Fri, Oct 21, 2011 at 4:25 AM, Sylvain Lebresne wrote: > I believe this is the same as > https://issues.apache.org/jira/browse/CASSANDRA-3306. > > The initial reporter only got this ex

Cassandra 1.0: Exception in compaction

keys at 5.388692MBPS. Time: 605ms. INFO [CompactionExecutor:541] 2011-10-20 10:52:54,806 CompactionTask.java (line 222) Compacted to [/var/lib/cassandra/data/MSA/modseq-h-268-Data.db,]. 4,467,791 to 4,227,199 (~94% of original) bytes for 43,572 keys at 5.389534MBPS. Time: 748ms. thanks Ramesh

nodetool ring Load column

What does the Load column in nodetool ring mean? From the output below it shows 101.62 GB. However if I do a disk usage it is about 6 GB. thanks Ramesh [root@CAP2-CNode1 cassandra]# ~root/apache-cassandra-1.0.0-rc2/bin/nodetool -h localhost ring Address DC RackStatus

read on multiple SS tables

max col value size will be less than 64mb. When you need to search for a value, we would read the one column and the application would manage looking up the appropriate value in the list of values. So I am wondering which option would be most efficient from read point of view. thanks Ramesh

Re: Consistency level and ReadRepair

805 ReadRepair difference : 354774 thanks Ramesh On Wed, Oct 5, 2011 at 2:21 PM, Jonathan Ellis wrote: > As explained in the link in my earlier reply, "Read Repair" just means > "a replica was checked in the background," not that it was out of > sync. > > On Wed, Oc

Re: Consistency level and ReadRepair

Yes Hinted Handoff is enabled. However I don't see any counters raising against the HintedHandoff in the tpstats. thanks Ramesh On Wed, Oct 5, 2011 at 2:10 PM, Mohit Anchlia wrote: > Do you see any errors in the logs? Is your HH enabled? > > On Wed, Oct 5, 2011 at 12:00 PM, Ra

Re: Consistency level and ReadRepair

easing just means you were doing reads at < CL.ALL, and had > the CF configured to perform RR. > > On Wed, Oct 5, 2011 at 12:37 PM, Ramesh Natarajan wrote: >> I have a 12 node cassandra cluster running with RF=3.  I have severl >> clients ( all running on a single node ) c

Memtable Switch Count

What is Memtable Switch Count in the cfstats output? thanks Ramesh

Re: nodetool cfstats on 1.0.0-rc1 throws an exception

stats counters in the system which is set to unsigned int instead of unsigned long? thanks Ramesh On Tue, Oct 4, 2011 at 3:20 AM, aaron morton wrote: > That row has a size of 819 peta bytes, so something is odd there. The error > is a result of that value been so huge. When you rant he sam

Consistency level and ReadRepair

se is returned to the client and ReadRepair is sent to C. This could happen only when C is running behind in catching up the updates to A,B. Are there any stats that would let me know if the system is in a consistent state? thanks Ramesh tpstats_2011-10-05_12:50:01:ReadRepairStage

Re: Cassandra JVM heap size

mx to 4GB. thanks Ramesh On Mon, Oct 3, 2011 at 10:25 PM, Jonathan Ellis wrote: > That's misleading, because you don't necessarily need to give the > memory to the JVM for Cassandra to make use of it. (See, for example, > > http://www.datastax.com/dev/blog/whats-new-in-ca

Re: nodetool cfstats on 1.0.0-rc1 throws an exception

We recreated the schema using the same input file on both clusters and they are running identical load. Isn't the exception thrown in the system CF? this line looks strange: Compacted row maximum size: 9223372036854775807 thanks Ramesh On Mon, Oct 3, 2011 at 5:26 PM, Jonathan Ellis

Re: nodetool cfstats on 1.0.0-rc1 throws an exception

It happens all the time on 1.0. It doesn't happen on 0.8.6. Is there any thing I can do to check? thanks Ramesh On Mon, Oct 3, 2011 at 5:15 PM, Jonathan Ellis wrote: > My suspicion would be that it has more to do with "rare case when > running with 5000 CFs" than "1

nodetool cfstats on 1.0.0-rc1 throws an exception

We have about 5000 column family and when we run the nodetool cfstats it throws out this exception... this is running 1.0.0-rc1 This seems to work on 0.8.6. Is this a bug in 1.0.0? thanks Ramesh Keyspace: system Read Count: 28 Read Latency: 5.8675 ms. Write Count: 3

node selection for replication factor 3

any random node? thanks Ramesh root@CAP4-CNode4 apache-cassandra-0.8.6]# ./bin/nodetool -h 127.0.0.1 ring Address DC RackStatus State LoadOwns Token 141784319550391026443072753096570088105 10.19.104.11datacenter1 rack1 Up Normal 19.92 GB

Re: help needed interpreting Read/Write latency in cfstats and cfhistograms output

cfstats showed 5 ms. Is this normal? thanks Ramesh On Mon, Oct 3, 2011 at 3:40 PM, aaron morton wrote: > Hi Rameash, > >Both tools output the "recent" latency, and while they do this > slightly differently, the result is that it's the latency since the last >

Re: cassandra performance degrades after 12 hours

families? thanks Ramesh On Mon, Oct 3, 2011 at 2:50 PM, Chris Goffinet wrote: > Most likely what could be happening is you are running single threaded > compaction. Look at the cassandra.yaml of how to enable multi-threaded > compaction. As more data comes into the system, bigger

Re: cassandra performance degrades after 12 hours

I will start another test run to collect these stats. Our test model is in the neighborhood of 4500 inserts, 8000 updates&deletes and 1500 reads every second across 6 servers. Can you elaborate more on reducing the heap space? Do you think it is a problem with 17G RSS? thanks Ramesh On

Re: cassandra performance degrades after 12 hours

We have 5 CF. Attached is the output from the describe command. We don't have row cache enabled. Thanks Ramesh Keyspace: MSA: Replication Strategy: org.apache.cassandra.locator.SimpleStrategy Durable Writes: true Options: [replication_factor:3] Column Families: ColumnF

cassandra performance degrades after 12 hours

I am running a cassandra cluster of 6 nodes running RHEL6 virtualized by ESXi 5.0. Each VM is configured with 20GB of ram and 12 cores. Our test setup performs about 3000 inserts per second. The cassandra data partition is on a XFS filesystem mounted with options (noatime,nodiratime,nobarrier,l

help needed interpreting Read/Write latency in cfstats and cfhistograms output

18 ms respectively. However per cfhistogram output the latency doesn't look correct. Attached are the output.. Can someone explain how to correlate the data? Thanks Ramesh cfstats Column Family: uid SSTable count: 10 Space used (live): 7453864915

Re: is it advisable to keep the data that is not frequently read/written to the database else where ?

Ramesh On Fri, Sep 30, 2011 at 10:30 AM, Jonathan Ellis wrote: > Short answer: no. > > Longer: What problems do you hope to avoid by adding this complexity? > > On Fri, Sep 30, 2011 at 9:45 AM, Ramesh S wrote: > > > > > > I have some data that would be re

is it advisable to keep the data that is not frequently read/written to the database else where ?

I have some data that would be read/write might be once during the entire session, like authentication info. When designing database with Cassandra is it advisable to keep the data that is not frequently read/written to the database else where ? Thank you regards, Ramesh

Re: create super column family for

I am using 0.8.6. On Thu, Sep 29, 2011 at 11:10 PM, Yi Yang wrote: > ** Which version are you using? In my memory 0.8.3 cannot do it correctly > but later versions fixed the bug. > > 從我的 BlackBerry(R) 無線裝置 > ------ > *From: * Ramesh S > *Date: *Thu,

Re: Is LexicalUUID a good option for generating Ids

Thanks Yi, I am using compound rowkeys in other column families which use this Id (UUID in this case). What I am looking for is unique Ids as a base point and I am hoping UUID is the best way to go. regards, Ramesh On Thu, Sep 29, 2011 at 4:28 PM, Yi Yang wrote: > ** I don't k

Re: Is LexicalUUID a good option for generating Ids

Thanks Aaron. Appreciate your valuable input/advice. regards, Ramesh On Thu, Sep 29, 2011 at 4:21 PM, aaron morton wrote: > UUID will be fine, LexicalUUID should be used for version 2,3,4 and 5 > UUID's. TimeUUID for version 1. > > A > > - > Aaron Mo

Re: create super column family for

tion_class: UTF8Type} {column_name: lenght, validation_class: UTF8Type} {column_name: width, validation_class: UTF8Type} ]; regards, Ramesh On Thu, Sep 29, 2011 at 3:23 PM, Ramesh S wrote: > I am trying to create a super column family using Cli command. > But I am not getting it. >

create super column family for

lumn_metadata = [ {column_name: subProdName, validation_class: UTF8Type} {column_name: lenght, validation_class: UTF8Type} {column_name: width, validation_class: UTF8Type} ]; Appreciate any help regards Ramesh

Is LexicalUUID a good option for generating Ids

We have to assign Id for each item in our database. Item is linked to geo location and hence would need hundreds of millions of Ids. So is LexicalUUID a good option ? regards, Ramesh

Re: unable to start as a service on Ubuntu server

Thanks a lot Shyamal. That was the solution. It works now :) regards Ramesh On Tue, Sep 27, 2011 at 8:36 PM, Shyamal Prasad wrote: > > >>>>> "Ramesh" =3D=3D Ramesh S writes: > >Ramesh> Hello all, We installed Cassandra on our development >

Re: unable to start as a service on Ubuntu server

--- > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 28/09/2011, at 12:34 PM, Ramesh S wrote: > > On IRC channel, I was told that 'service' clears the environment variables. > Just in case , some one might be having

Re: unable to start as a service on Ubuntu server

On Tue, Sep 27, 2011 at 5:49 PM, Ramesh S wrote: > Thanks Konstantin. > > I checked the services, but it doesn't show up for some reason. Even trying > to connect locally or remotely using a CLI client, returned > Exception connecting to xx.xx.xx.xx/9160. Reason: Connecti

Re: unable to start as a service on Ubuntu server

I am surprised why omitting the 'service' did the job. It is development server, but I am little concerned about the production server. regards Ramesh On Tue, Sep 27, 2011 at 5:12 PM, Konstantin Naryshkin wrote: > Yes, they start Cassandra as a daemon in the background. It is running.

unable to start as a service on Ubuntu server

> > Hello all, > > We installed Cassandra on our development server , which is a fresh Ubuntu > server running only Cassandra. > We followed all the instructions on this > link and > when we want to start the server as a service by issuing

reverse range query performance

asking for columns 1500 (start ) - 1400 (end ) with reverse set to true. Does cassandra read the entire row 1 - 1500 columns and then return the result 1400 - 1500 or it is optimized to look directly into the 1400 - 1500 columns? thanks Ramesh SliceRange A SliceRange is a structure that