RE: Saving a file using cassandra

2015-03-30 Thread Peer, Oded
Try this http://stackoverflow.com/a/17208343/248656 From: jean paul [mailto:researche...@gmail.com] Sent: Wednesday, March 18, 2015 7:06 PM To: user@cassandra.apache.org Subject: Saving a file using cassandra Hello, Finally, i have created my ring using cassandra. Please, i'd like to store a fil

RE: sstable writer and creating bytebuffers

2015-03-30 Thread Peer, Oded
Thanks Sylvain. Is there any way to create a composite key with only one column in Cassandra when creating a table, or should creating a CompositeType instance with a single column be prohibited? From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Monday, March 30, 2015 1:57 PM To: user@

Re: SSTable structure

2015-03-30 Thread Jacob Rhoden
Yes updating code and documentation can sometimes be annoying, you would only ever maintain both if it were important. It comes down or is having the format of the data files documented for everyone to understand an important thing? __ Sent from iPhone > On 31 Mar 2

Re: SSTable structure

2015-03-30 Thread Kirk True
The tricky thing with documenting the SS tables is that there are a lot of conditionals in the structure, so it makes for twisty reading. Just for fun, here's a terrible start I made once: https://github.com/mustardgrain/cassandra-notes/blob/master/SSTables.md On Mon, Mar 30, 2015, at 05:12 PM,

Re: SSTable structure

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 5:07 PM, daemeon reiydelle wrote: > why? Then there are 2 places 2 maintain or get jira'ed for a discrepancy. > If you are asserting that code is capable of documenting itself, we will just have to agree to disagree. =Rob

Re: SSTable structure

2015-03-30 Thread daemeon reiydelle
why? Then there are 2 places 2 maintain or get jira'ed for a discrepancy. On Mar 30, 2015 4:46 PM, "Robert Coli" wrote: > On Mon, Mar 30, 2015 at 1:38 AM, Pierre wrote: > >> Does anyone know if there is a more complete and up to date documentation >> about the sstable files structure (data, inde

Re: SSTable structure

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 1:38 AM, Pierre wrote: > Does anyone know if there is a more complete and up to date documentation > about the sstable files structure (data, index, stats etc.) than this one : > http://wiki.apache.org/cassandra/ArchitectureSSTable No, there isn't. Unfortunately you will

Re: Cassandra 2.1.3: OOM during bootstrap

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 2:08 AM, Nathan Bijnens wrote: > We are getting a OOM when adding a new node to an existing cluster. In the > heapdump we found that this thread caused the OutOfMemory exception: > > "SharedPool-Worker-10" daemon prio=5 tid=440 RUNNABLE > This type of post is probably bet

Re: Issue with removing a node and adding it back

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 4:27 PM, Shiwen Cheng wrote: > Thanks Robert! > Yes I tried what you said: clean the data and re-bootstrap. But still it > failed, once at the point of 600GB transferred and once at 1.1TB :( > 1) figure out what is making your streams die (usually either flaky network (A

Re: nodetool cleanup error

2015-03-30 Thread Yuki Morishita
Looks like the issue is https://issues.apache.org/jira/browse/CASSANDRA-9070. On Mon, Mar 30, 2015 at 6:25 PM, Robert Coli wrote: > On Mon, Mar 30, 2015 at 4:21 PM, Amlan Roy wrote: >> >> Thanks for the reply. I have upgraded to 2.0.13. Now I get the following >> error. > > > If cleanup is still

Re: upgrade from 1.0.12 to 1.1.12

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 4:01 AM, Jason Wee wrote: > Rob, the cluster now upgraded to cassandra 1.0.12 (default hd version, > in Descriptor.java) and I ensure all sstables in current cluster are > hd version before upgrade to cassandra 1.1. I have also checked in > cassandra 1.1.12 , the sstable i

Re: upgrade from 1.0.12 to 1.1.12

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 7:20 AM, Jonathan Haddad wrote: > Running upgrade is a noop if the tables don't need to be upgraded. I > consider the cost of this to be less than the cost of missing an upgrade. Oh, right! This optimization was added, which means I totally and completely agree with you.

Re: nodetool cleanup error

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 4:21 PM, Amlan Roy wrote: > Thanks for the reply. I have upgraded to 2.0.13. Now I get the following > error. > If cleanup is still excepting for you on 2.0.13 with some sstables you have, I would strongly consider : 1) file a JIRA (http://issues.apache.org) and attach /

Re: nodetool cleanup error

2015-03-30 Thread Amlan Roy
Hi, Thanks for the reply. I have upgraded to 2.0.13. Now I get the following error. Regards, Amlan Exception in thread "main" java.lang.AssertionError: [SSTableReader(path='/data/1/cassandra/data/xxx/xxx/xxx.db'), SSTableReader(path='/data/1/cassandra/data/xxx/xxx/xxx.db')] at org.apa

Re: Why select returns tombstoned results?

2015-03-30 Thread Benyi Wang
Thanks for replying. In cqlsh, if I change to Quorum (Consistency quorum), sometime the select return the deleted row, sometime not. I have two virtual data centers: service (3 nodes) and analytics(4 nodes collocate with Hadoop data nodes).The table has 3 replicas in service and 2 in analytics. W

Re: nodetool cleanup error

2015-03-30 Thread Jeff Ferland
Code problem that was patched in https://issues.apache.org/jira/browse/CASSANDRA-8716 . Upgrade to 2.0.13 > On Mar 30, 2015, at 1:12 PM, Amlan Roy wrote: > > Hi, > > I have added new nodes to an existing cluster and ran the “nodetool clea

Re: nodetool cleanup error

2015-03-30 Thread Duncan Sands
Hi Amlan, On 30/03/15 22:12, Amlan Roy wrote: Hi, I have added new nodes to an existing cluster and ran the “nodetool cleanup”. I am getting the following error. Wanted to know if there is any solution to it. Regards, Amlan Error occurred during cleanup java.util.concurrent.ExecutionException

nodetool cleanup error

2015-03-30 Thread Amlan Roy
Hi, I have added new nodes to an existing cluster and ran the “nodetool cleanup”. I am getting the following error. Wanted to know if there is any solution to it. Regards, Amlan Error occurred during cleanup java.util.concurrent.ExecutionException: java.lang.AssertionError: Memory was freed

Re: Why select returns tombstoned results?

2015-03-30 Thread Prem Yadav
Increase the read CL to quorum and you should get correct results. How many nodes do you have in the cluster and what is the replication factor for the keyspace? On Mon, Mar 30, 2015 at 7:41 PM, Benyi Wang wrote: > Create table tomb_test ( >guid text, >content text, >range text, >

Why select returns tombstoned results?

2015-03-30 Thread Benyi Wang
Create table tomb_test ( guid text, content text, range text, rank int, id text, cnt int primary key (guid, content, range, rank) ) Sometime I delete the rows using cassandra java driver using this query DELETE FROM tomb_test WHERE guid=? and content=? and range=? in Batch s

importing files into cassandra, and feauture enhancements in cassandra

2015-03-30 Thread Divya Divs
hi everyone.. I'm a m-tech student. my academic project is cassandra. I have run the source code of cassandra in eclipse juno using ant build. https://github.com/apache/cassandra. i have to do some feature enhancement in cassandra. After enhancing i hav to import crime datasets into the cassandra

Re: sstable writer and creating bytebuffers

2015-03-30 Thread Sylvain Lebresne
No, it's not a bug. In a composite every elements start by a 2 short indicating the size of the element, plus an extra byte that is used for sorting purposes. A little bit more details can be found in the CompositeType class javadoc if you're interested. It's not the most compact format there is bu

sstable writer and creating bytebuffers

2015-03-30 Thread Peer, Oded
I am writing code to bulk load data into Cassandra using SSTableSimpleUnsortedWriter I changed my partition key from a composite key (long, int) to a single column key (long). For creating the composite key I used a CompositeType, and I kept using it after changing the key to a single column. My

Re: sstable loader

2015-03-30 Thread Amila Paranawithana
Hi Rahul, By just seeing the error I guess the file name you have given need to be changed to to format file:/// .Not sure anyway. Cheers! Amila On Mon, Mar 30, 2015 at 1:46 PM, Rahul Bhardwaj < rahul.bhard...@indiamart.com> wrote: > Hi Venessa, > > Thanks for sharing. > > But when after co

Re: SSTable structure

2015-03-30 Thread ssiv...@gmail.com
+1 On 03/30/2015 11:38 AM, Pierre wrote: Hi, Does anyone know if there is a more complete and up to date documentation about the sstable files structure (data, index, stats etc.) than this one : http://wiki.apache.org/cassandra/ArchitectureSSTable I'm looking for a full specification, with

Cassandra 2.1.3: OOM during bootstrap

2015-03-30 Thread Nathan Bijnens
We are getting a OOM when adding a new node to an existing cluster. In the heapdump we found that this thread caused the OutOfMemory exception: "SharedPool-Worker-10" daemon prio=5 tid=440 RUNNABLE at java.lang.OutOfMemoryError.(OutOfMemoryError.java:48) at java.nio.HeapByteBuffer.(HeapByteBuffer

SSTable structure

2015-03-30 Thread Pierre
Hi, Does anyone know if there is a more complete and up to date documentation about the sstable files structure (data, index, stats etc.) than this one : http://wiki.apache.org/cassandra/ArchitectureSSTable I'm looking for a full specification, with schema of the structure if possible. Thanks

Re: sstable loader

2015-03-30 Thread Rahul Bhardwaj
Hi Venessa, Thanks for sharing. But when after compiling BulkLoad.java, on executing it is returning Exception in thread "main" java.lang.NoClassDefFoundError: BulkLoad (wrong name: bulkload/BulkLoad) had you also seen this. Regards: Rahul Bhardwaj On Mon, Mar 30, 2015 at 12:57 PM, Vanessa G

Re: sstable loader

2015-03-30 Thread Vanessa Gligor
Hi, I used this https://github.com/yukim/cassandra-bulkload-example/ (I have modified BulkLoad.java for my needs) for the sstable loader and it works ok. You can take a look, maybe it will help you. Regards, Vanessa. On Mon, Mar 30, 2015 at 10:04 AM, Rahul Bhardwaj < rahul.bhard...@indiamart.com

Re: sstable loader

2015-03-30 Thread Rahul Bhardwaj
Hi Amila , I tried your code. In which we made some modification accordingly like: public class DataImportExample { static String filename; public static void main(String[] args) throws IOException { filename = "/root/perl_work/abc.csv"; BufferedReader reader = new Bu